Apr 24 14:35:34 devstack cinder-volume[71868]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 24 14:35:34 devstack cinder-volume[71868]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 14:35:34 devstack cinder-volume[71868]: we strongly recommend against using it for new projects.
Apr 24 14:35:34 devstack cinder-volume[71868]: If you are already using Eventlet, we recommend migrating to a different
Apr 24 14:35:34 devstack cinder-volume[71868]: framework.  For more detail see
Apr 24 14:35:34 devstack cinder-volume[71868]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 14:35:34 devstack cinder-volume[71868]:   import eventlet  # noqa
Apr 24 14:35:36 devstack cinder-volume[71868]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=71868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 14:35:36 devstack cinder-volume[71868]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=71868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 14:35:36 devstack cinder-volume[71868]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=71868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 14:35:36 devstack cinder-volume[71868]: INFO dbcounter [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Registered counter for database cinder
Apr 24 14:35:36 devstack cinder-volume[71868]: DEBUG oslo_db.sqlalchemy.engines [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG dbcounter [-] [71868] Writer thread running {{(pid=71868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 14:35:37 devstack cinder-volume[71868]: INFO cinder.rpc [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 24 14:35:37 devstack cinder-volume[71868]: INFO cinder.rpc [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_db.sqlalchemy.engines [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:35:37 devstack cinder-volume[71868]: INFO cinder.volume.manager [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Determined volume DB was empty at startup.
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG cinder.volume.manager [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=71868) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 24 14:35:37 devstack cinder-volume[71868]: INFO cinder.volume.manager [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 24 14:35:37 devstack cinder-volume[71868]: WARNING stevedore.named [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 14:35:37 devstack cinder-volume[71868]: WARNING castellan.key_manager [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 14:35:37 devstack cinder-volume[71868]: WARNING cinder.keymgr.conf_key_mgr [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG cinder.volume.drivers.lvm [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=71868) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_concurrency.processutils [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=71868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_concurrency.processutils [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.302s {{(pid=71868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_db.sqlalchemy.engines [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:35:37 devstack cinder-volume[71868]: INFO cinder.rpc [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 24 14:35:37 devstack cinder-volume[71868]: INFO cinder.rpc [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 24 14:35:37 devstack cinder-volume[71868]: WARNING stevedore.named [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 14:35:37 devstack cinder-volume[71868]: WARNING castellan.key_manager [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 14:35:37 devstack cinder-volume[71868]: INFO cinder.volume.manager [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_db.sqlalchemy.engines [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:35:37 devstack cinder-volume[71868]: INFO oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Starting 1 workers
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Started child 71969 {{(pid=71868) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Full set of CONF: {{(pid=71868) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] ******************************************************************************** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Configuration options gathered from: {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 24 14:35:37 devstack cinder-volume[71969]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] ================================================================================ {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] allow_availability_zone_fallback = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] allow_compression_on_image_upload = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] allowed_direct_url_schemes     = [] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] api_rate_limit                 = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] auth_strategy                  = keystone {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] az_cache_duration              = 3600 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_availability_zone      = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_host                   = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_name                   = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_stats_polling_interval = 60 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backup_api_class               = cinder.backup.api.API {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backup_name_template           = backup-%s {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backup_use_same_host           = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backup_use_temp_snapshot       = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] chap_password                  = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] chap_username                  =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cinder_internal_tenant_project_id = ca10a348366641dcb3b631933306f5bc {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cinder_internal_tenant_user_id = bcc4d7410cce441aac1ef0d270179dfe {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cloned_volume_same_az          = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cluster                        = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] compression_format             = gzip {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] compute_api_class              = cinder.compute.nova.API {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] config_dir                     = [] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] config_source                  = [] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] control_exchange               = openstack {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] debug                          = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] default_availability_zone      = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] default_group_type             = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] default_volume_type            = lvmdriver-1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] disk_geometry                  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] driver_client_cert             = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] driver_client_cert_key         = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] driver_data_namespace          = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] driver_ssl_cert_path           = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] driver_ssl_cert_verify         = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71969]: INFO cinder.volume.manager [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] driver_use_ssl                 = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] enable_force_upload            = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] enable_new_services            = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] enable_unsupported_driver      = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] enforce_multipath_for_image_xfer = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] filter_function                = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance_api_insecure            = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance_api_servers             = ['http://192.168.122.34/image'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance_api_ssl_compression     = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance_ca_certificates_file    = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance_catalog_info            = image:glance:publicURL {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance_certfile                = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance_keyfile                 = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance_num_retries             = 3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance_request_timeout         = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] goodness_function              = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] graceful_shutdown_timeout      = 5 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] group_api_class                = cinder.group.api.API {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] host                           = devstack {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] image_compress_on_upload       = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] image_conversion_address_space_limit = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] image_conversion_cpu_limit     = 60 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] image_conversion_disable       = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] image_upload_use_cinder_backend = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] image_upload_use_internal_tenant = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] image_volume_cache_enabled     = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] image_volume_cache_max_count   = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] image_volume_cache_max_size_gb = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] init_host_max_objects_retrieval = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] iscsi_target_flags             =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] iscsi_write_cache              = on {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] iser_helper                    = tgtadm {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] iser_ip_address                = 192.168.122.34 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] iser_port                      = 3260 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] log_color                      = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] log_config_append              = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] log_dir                        = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] log_file                       = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] log_options                    = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] log_rotate_interval            = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] log_rotate_interval_type       = days {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] log_rotation_type              = none {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] max_age                        = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] max_logfile_count              = 30 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] max_logfile_size_mb            = 200 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] max_over_subscription_ratio    = 20.0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] message_reap_interval          = 86400 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] message_ttl                    = 2592000 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] migration_create_volume_timeout_secs = 300 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] monkey_patch                   = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] monkey_patch_modules           = [] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] my_ip                          = 192.168.122.34 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] no_snapshot_gb_quota           = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] num_iser_scan_tries            = 3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] num_shell_tries                = 3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] num_volume_device_scan_tries   = 3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] nvmeof_conn_info_version       = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] nvmet_ns_id                    = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] nvmet_port_id                  = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] osapi_max_limit                = 1000 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] osapi_volume_ext_list          = [] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] osapi_volume_listen_port       = 8776 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] osapi_volume_use_ssl           = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] osapi_volume_workers           = 2 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] per_volume_size_limit          = -1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] periodic_fuzzy_delay           = 60 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] periodic_interval              = 60 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] public_endpoint                = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] publish_errors                 = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] quota_backup_gigabytes         = 1000 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] quota_backups                  = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] quota_gigabytes                = 1000 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] quota_groups                   = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] quota_snapshots                = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] quota_volumes                  = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] rate_limit_burst               = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] rate_limit_except_level        = CRITICAL {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] rate_limit_interval            = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] reinit_driver_count            = 3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] replication_device             = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] report_discard_supported       = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] report_interval                = 120 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] reservation_clean_interval     = 86400 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] reservation_expire             = 86400 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] reserved_image_namespaces      = [] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] reserved_percentage            = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] rpc_response_timeout           = 120 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] run_external_periodic_tasks    = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] scst_target_driver             = iscsi {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] scst_target_iqn_name           = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:37 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] service_down_time              = 720 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] shell_completion               = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] snapshot_name_template         = snapshot-%s {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] snapshot_same_host             = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] split_loggers                  = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] state_path                     = /opt/stack/data/cinder {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] storage_availability_zone      = nova {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] storage_protocol               = iSCSI {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] syslog_log_facility            = LOG_USER {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] target_helper                  = lioadm {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] target_ip_address              = 192.168.122.34 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] target_port                    = 3260 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] target_protocol                = iscsi {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] target_secondary_ip_addresses  = [] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] trace_flags                    = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] transport_url                  = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] until_refresh                  = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] use_chap_auth                  = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] use_default_quota_class        = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] use_journal                    = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] use_json                       = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] use_multipath_for_image_xfer   = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] use_stderr                     = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] use_syslog                     = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] verify_glance_signatures       = enabled {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_api_class               = cinder.volume.api.API {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_backend_name            = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_clear                   = zero {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_clear_ionice            = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_clear_size              = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_copy_bps_limit          = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_dd_blocksize            = 1M {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_name_template           = volume-%s {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_service_inithost_offload = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volume_usage_audit_period      = month {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] zoning_mode                    = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_concurrency.disable_process_locking = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.admin_password = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.admin_token = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.admin_user  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.auth_port   = 35357 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.auth_protocol = https {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.auth_section = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.auth_type   = password {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.auth_uri    = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.auth_version = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.cache       = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.certfile    = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack sudo[71979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.identity_uri = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.include_service_catalog = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack sudo[71979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.insecure    = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.interface   = public {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.keyfile     = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_password =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcache_username =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.region_name = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.service_type = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.backend                  = dogpile.cache.null {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.backend_argument         = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.backend_expiration_time  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.config_prefix            = cache.oslo {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.debug_cache_backend      = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.enable_retry_client      = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.enable_socket_keepalive  = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.enabled                  = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.enforce_fips_mode        = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.expiration_time          = 600 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.hashclient_retry_attempts = 2 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.memcache_dead_retry      = 300 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.memcache_sasl_enabled    = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.password                 = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.proxies                  = [] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.redis_db                 = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.redis_server             = localhost:6379 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.retry_attempts           = 2 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.retry_delay              = 0.0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.socket_keepalive_count   = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.socket_keepalive_idle    = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.socket_keepalive_interval = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.socket_timeout           = 1.0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.tls_allowed_ciphers      = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.tls_cafile               = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.tls_certfile             = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.tls_enabled              = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.tls_keyfile              = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cache.username                 = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] coordination.backend_url       = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.asyncio_connection    = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.asyncio_slave_connection = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.backend               = sqlalchemy {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.connection            = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.connection_debug      = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.connection_parameters =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.connection_recycle_time = 3600 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.connection_trace      = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.db_inc_retry_interval = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.db_max_retries        = 20 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.db_max_retry_interval = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.db_retry_interval     = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.max_overflow          = 50 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.max_pool_size         = 5 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.max_retries           = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.mysql_wsrep_sync_wait = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.pool_timeout          = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.retry_interval        = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.slave_connection      = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.sqlite_synchronous    = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.synchronous_reader    = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] database.use_db_reconnect      = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler.connection_string     = messaging:// {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler.enabled               = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler.es_doc_type           = notification {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler.es_scroll_size        = 10000 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler.es_scroll_time        = 2m {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler.filter_error_trace    = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler.hmac_keys             = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler.sentinel_service_name = mymaster {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler.socket_timeout        = 0.1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler.trace_requests        = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler.trace_sqlalchemy      = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler_jaeger.process_tags   = {} {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler_jaeger.service_name_prefix = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] profiler_otlp.service_name_prefix = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_policy.enforce_new_defaults = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: WARNING oslo_config.cfg [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_policy.enforce_scope      = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_policy.policy_default_rule = default {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] privsep_osbrick.group          = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] privsep_osbrick.helper_command = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] privsep_osbrick.user           = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cinder_sys_admin.group         = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cinder_sys_admin.helper_command = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] cinder_sys_admin.user          = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] service_user.auth_section      = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] service_user.auth_type         = password {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] service_user.cafile            = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] service_user.certfile          = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] service_user.collect_timing    = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] service_user.insecure          = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] service_user.keyfile           = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] service_user.send_service_user_token = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] service_user.split_loggers     = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] service_user.timeout           = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance.auth_section            = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance.auth_type               = password {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance.certfile                = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance.collect_timing          = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance.insecure                = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance.keyfile                 = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance.region_name             = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance.split_loggers           = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] glance.timeout                 = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.backend_availability_zone = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.chap_password = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.chap_username =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.disk_geometry = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.driver_client_cert = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.driver_client_cert_key = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.driver_data_namespace = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.driver_use_ssl = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.extra_capabilities = {} {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.filter_function = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.goodness_function = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.iscsi_target_flags =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.iscsi_write_cache = on {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.iser_helper   = tgtadm {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.iser_port     = 3260 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.lvm_share_target = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.lvm_type      = auto {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.num_shell_tries = 3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.replication_device = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.report_discard_supported = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.reserved_percentage = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.target_helper = tgtadm {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.target_port   = 3260 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.target_protocol = iscsi {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.trace_flags   = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.unique_fqdn_network = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.use_chap_auth = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.volume_backend_name = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.volume_clear  = zero {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.volume_clear_ionice = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.volume_clear_size = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_reports.file_event_handler = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_reports.log_dir           = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.backend_host       = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.chap_password      = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.chap_username      = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.disk_geometry      = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.driver_client_cert = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.extra_capabilities = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.filter_function    = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.goodness_function  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.iser_helper        = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.iser_ip_address    = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.iser_port          = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.lvm_share_target   = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.lvm_type           = auto {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.num_shell_tries    = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.replication_device = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.report_discard_supported = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.reserved_percentage = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.scst_target_driver = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.storage_protocol   = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.target_helper      = lioadm {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.target_ip_address  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.target_port        = 3260 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.trace_flags        = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.use_chap_auth      = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.volume_clear       = zero {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.volume_clear_size  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] lvmdriver-1.volumes_dir        = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_notifications.driver = [] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_notifications.retry = -1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] key_manager.fixed_key          = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.barbican_api_version  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.barbican_endpoint     = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.barbican_endpoint_type = public {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.barbican_region_name  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.cafile                = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.certfile              = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.collect_timing        = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.insecure              = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.keyfile               = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.number_of_retries     = 60 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.retry_delay           = 1 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.send_service_user_token = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.split_loggers         = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.timeout               = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.verify_ssl            = True {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican.verify_ssl_path       = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican_service_user.auth_section = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican_service_user.auth_type = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican_service_user.cafile   = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican_service_user.certfile = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican_service_user.collect_timing = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican_service_user.insecure = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican_service_user.keyfile  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican_service_user.split_loggers = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] barbican_service_user.timeout  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vault.approle_role_id          = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vault.approle_secret_id        = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vault.kv_mountpoint            = secret {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vault.kv_path                  = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vault.kv_version               = 2 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vault.namespace                = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vault.root_token_id            = **** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vault.ssl_ca_crt_file          = None {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vault.timeout                  = 60.0 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vault.use_ssl                  = False {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:35:37 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] ******************************************************************************** {{(pid=71868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 24 14:35:38 devstack sudo[71979]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:38 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.573s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:38 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:38 devstack sudo[72172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:35:38 devstack sudo[72172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:38 devstack sudo[72172]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:38 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.501s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:38 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:35:38 devstack cinder-volume[71969]: INFO cinder.brick.local_dev.lvm [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 24 14:35:38 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:38 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:38 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:38 devstack sudo[72390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 14:35:38 devstack sudo[72390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:39 devstack sudo[72390]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:39 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:39 devstack cinder-volume[71969]: DEBUG cinder.brick.local_dev.lvm [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=71969) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 24 14:35:39 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:39 devstack sudo[72490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:35:39 devstack sudo[72490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:40 devstack sudo[72490]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:40 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.982s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:40 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:40 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:40 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:40 devstack sudo[72654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:35:40 devstack sudo[72654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:41 devstack sudo[72654]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:41 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:41 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:41 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:41 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:41 devstack sudo[72658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 24 14:35:41 devstack sudo[72658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:41 devstack sudo[72658]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:41 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.520s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:41 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:41 devstack sudo[72661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 14:35:41 devstack sudo[72661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:42 devstack sudo[72661]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:42 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.554s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:42 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:42 devstack sudo[72667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 14:35:42 devstack sudo[72667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:42 devstack sudo[72667]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:42 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.526s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:42 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:42 devstack sudo[72674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:35:42 devstack sudo[72674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:43 devstack sudo[72674]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:43 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:43 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:43 devstack sudo[72678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:35:43 devstack sudo[72678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:43 devstack sudo[72678]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:43 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:43 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:43 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:43 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:43 devstack sudo[72682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:35:43 devstack sudo[72682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:44 devstack sudo[72682]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:44 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.694s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:44 devstack cinder-volume[71969]: INFO cinder.volume.drivers.lvm [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 24 14:35:44 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:44 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:44 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:44 devstack sudo[72800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:35:44 devstack sudo[72800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:44 devstack sudo[72800]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:44 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.506s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:44 devstack cinder-volume[71969]: DEBUG cinder.volume.drivers.lvm [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Updating volume stats {{(pid=71969) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 14:35:44 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:44 devstack sudo[72806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 14:35:44 devstack sudo[72806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:45 devstack sudo[72806]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:45 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:45 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:45 devstack sudo[72946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:35:45 devstack sudo[72946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:45 devstack sudo[72946]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:45 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:45 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:45 devstack sudo[72950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:35:45 devstack sudo[72950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:46 devstack sudo[72950]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:46 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.508s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:46 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:46 devstack sudo[72953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:35:46 devstack sudo[72953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:46 devstack sudo[72953]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:46 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:46 devstack cinder-volume[71969]: INFO cinder.volume.driver [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Driver hasn't implemented _init_vendor_properties()
Apr 24 14:35:46 devstack cinder-volume[71969]: DEBUG cinder.volume.driver [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=71969) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 24 14:35:46 devstack cinder-volume[71969]: DEBUG oslo_db.sqlalchemy.engines [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:35:46 devstack cinder-volume[71969]: DEBUG dbcounter [-] [71969] Writer thread running {{(pid=71969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 14:35:46 devstack cinder-volume[71969]: DEBUG cinder.db.sqlalchemy.api [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Building query based on filter {{(pid=71969) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 24 14:35:46 devstack cinder-volume[71969]: DEBUG cinder.image.image_utils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=71969) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 24 14:35:46 devstack cinder-volume[71969]: INFO cinder.keymgr.migration [None req-952cd59a-a889-4c7b-8e5d-46c2eb2e68f1 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 24 14:35:46 devstack cinder-volume[71969]: DEBUG cinder.volume.drivers.lvm [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Updating volume stats {{(pid=71969) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 14:35:46 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:46 devstack sudo[72961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 14:35:46 devstack sudo[72961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:47 devstack sudo[72961]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:47 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:47 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:47 devstack sudo[72964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:35:47 devstack sudo[72964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:47 devstack cinder-volume[71868]: DEBUG dbcounter [-] [71868] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=71868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:35:48 devstack sudo[72964]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:48 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:48 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:48 devstack sudo[72969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:35:48 devstack sudo[72969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:48 devstack sudo[72969]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:48 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:48 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:48 devstack sudo[72973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:35:48 devstack sudo[72973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:48 devstack sudo[72973]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:49 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:49 devstack cinder-volume[71969]: DEBUG cinder.manager [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Notifying Schedulers of capabilities ... {{(pid=71969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:35:49 devstack cinder-volume[71969]: INFO cinder.volume.manager [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Driver initialization completed successfully.
Apr 24 14:35:49 devstack cinder-volume[71969]: INFO cinder.manager [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Initiating service 2 cleanup
Apr 24 14:35:49 devstack cinder-volume[71969]: INFO cinder.manager [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Service 2 cleanup completed.
Apr 24 14:35:49 devstack cinder-volume[71969]: DEBUG cinder.service [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Creating RPC server for service cinder-volume {{(pid=71969) start /opt/stack/cinder/cinder/service.py:231}}
Apr 24 14:35:49 devstack cinder-volume[71969]: DEBUG cinder.service [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=71969) start /opt/stack/cinder/cinder/service.py:237}}
Apr 24 14:35:49 devstack cinder-volume[71969]: INFO cinder.volume.manager [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 24 14:35:49 devstack cinder-volume[71969]: DEBUG cinder.volume.drivers.lvm [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Updating volume stats {{(pid=71969) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 14:35:49 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:49 devstack sudo[72980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 14:35:49 devstack sudo[72980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:49 devstack sudo[72980]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:49 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.515s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:49 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:49 devstack sudo[72985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:35:49 devstack sudo[72985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:50 devstack sudo[72985]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:50 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.570s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:50 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:50 devstack sudo[72988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:35:50 devstack sudo[72988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:50 devstack sudo[72988]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:50 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:50 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:35:50 devstack sudo[73045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:35:50 devstack sudo[73045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:35:51 devstack sudo[73045]: pam_unix(sudo:session): session closed for user root
Apr 24 14:35:51 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:35:51 devstack cinder-volume[71969]: INFO cinder.volume.manager [None req-b9d036bb-9c9e-46a5-8239-365eb4e9d5fe None None] Driver post RPC initialization completed successfully.
Apr 24 14:35:59 devstack cinder-volume[71969]: DEBUG dbcounter [-] [71969] Writing DB stats cinder:SELECT=2 {{(pid=71969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:36:01 devstack cinder-volume[71969]: DEBUG dbcounter [-] [71969] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=71969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:37:15 devstack cinder-volume[71969]: DEBUG oslo_service.periodic_task [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:37:15 devstack cinder-volume[71969]: DEBUG cinder.volume.drivers.lvm [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Updating volume stats {{(pid=71969) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 14:37:15 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:37:15 devstack sudo[77890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 14:37:15 devstack sudo[77890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:37:15 devstack sudo[77890]: pam_unix(sudo:session): session closed for user root
Apr 24 14:37:15 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.545s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:37:15 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:37:15 devstack sudo[77894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:37:15 devstack sudo[77894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:37:16 devstack sudo[77894]: pam_unix(sudo:session): session closed for user root
Apr 24 14:37:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:37:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:37:16 devstack sudo[77898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:37:16 devstack sudo[77898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:37:16 devstack sudo[77898]: pam_unix(sudo:session): session closed for user root
Apr 24 14:37:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:37:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:37:16 devstack sudo[77902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:37:16 devstack sudo[77902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:37:17 devstack sudo[77902]: pam_unix(sudo:session): session closed for user root
Apr 24 14:37:17 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:37:17 devstack cinder-volume[71969]: DEBUG cinder.manager [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Notifying Schedulers of capabilities ... {{(pid=71969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:38:01 devstack cinder-volume[71969]: DEBUG dbcounter [-] [71969] Writing DB stats cinder:SELECT=1 {{(pid=71969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:38:01 devstack cinder-volume[71969]: DEBUG dbcounter [-] [71969] Writing DB stats cinder:UPDATE=1 {{(pid=71969) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:38:15 devstack cinder-volume[71969]: DEBUG oslo_service.periodic_task [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:38:15 devstack cinder-volume[71969]: DEBUG cinder.volume.drivers.lvm [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Updating volume stats {{(pid=71969) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 14:38:15 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:38:15 devstack sudo[79594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 14:38:15 devstack sudo[79594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:38:15 devstack sudo[79594]: pam_unix(sudo:session): session closed for user root
Apr 24 14:38:15 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.501s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:38:15 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:38:15 devstack sudo[79616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:38:15 devstack sudo[79616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:38:16 devstack sudo[79616]: pam_unix(sudo:session): session closed for user root
Apr 24 14:38:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:38:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:38:16 devstack sudo[79644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:38:16 devstack sudo[79644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:38:16 devstack sudo[79644]: pam_unix(sudo:session): session closed for user root
Apr 24 14:38:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.500s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:38:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:38:16 devstack sudo[79662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:38:16 devstack sudo[79662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:38:17 devstack sudo[79662]: pam_unix(sudo:session): session closed for user root
Apr 24 14:38:17 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.490s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:38:17 devstack cinder-volume[71969]: DEBUG cinder.manager [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Notifying Schedulers of capabilities ... {{(pid=71969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:39:15 devstack cinder-volume[71969]: DEBUG oslo_service.periodic_task [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71969) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:39:15 devstack cinder-volume[71969]: DEBUG cinder.volume.drivers.lvm [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Updating volume stats {{(pid=71969) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 24 14:39:15 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:15 devstack sudo[80784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 24 14:39:15 devstack sudo[80784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:15 devstack sudo[80784]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:15 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:15 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:15 devstack sudo[80813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:39:15 devstack sudo[80813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:16 devstack sudo[80813]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:16 devstack sudo[80839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 24 14:39:16 devstack sudo[80839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:16 devstack sudo[80839]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.471s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:16 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:16 devstack sudo[80872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 24 14:39:16 devstack sudo[80872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:16 devstack cinder-volume[71868]: INFO oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Caught SIGTERM, stopping children
Apr 24 14:39:16 devstack cinder-volume[71868]: DEBUG oslo_concurrency.lockutils [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Acquiring lock "singleton_lock" {{(pid=71868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 14:39:16 devstack cinder-volume[71868]: DEBUG oslo_concurrency.lockutils [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Acquired lock "singleton_lock" {{(pid=71868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 14:39:16 devstack cinder-volume[71868]: DEBUG oslo_concurrency.lockutils [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Releasing lock "singleton_lock" {{(pid=71868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 14:39:16 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Stop services. {{(pid=71868) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 24 14:39:16 devstack cinder-volume[71868]: DEBUG oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Killing children. {{(pid=71868) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 24 14:39:16 devstack cinder-volume[71868]: INFO oslo_service.backend._eventlet.service [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Waiting on 1 children to exit
Apr 24 14:39:17 devstack sudo[80872]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:17 devstack cinder-volume[71969]: DEBUG oslo_concurrency.processutils [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=71969) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:17 devstack cinder-volume[71969]: DEBUG cinder.manager [None req-3925ba81-6d38-44d6-a8de-b0dbd1dc2dba None None] Notifying Schedulers of capabilities ... {{(pid=71969) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:39:21 devstack cinder-volume[71969]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Apr 24 14:39:22 devstack cinder-volume[80912]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 24 14:39:22 devstack cinder-volume[80912]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 14:39:22 devstack cinder-volume[80912]: we strongly recommend against using it for new projects.
Apr 24 14:39:22 devstack cinder-volume[80912]: If you are already using Eventlet, we recommend migrating to a different
Apr 24 14:39:22 devstack cinder-volume[80912]: framework.  For more detail see
Apr 24 14:39:22 devstack cinder-volume[80912]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 14:39:22 devstack cinder-volume[80912]:   import eventlet  # noqa
Apr 24 14:39:24 devstack cinder-volume[71969]: DEBUG oslo_concurrency.lockutils [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Acquiring lock "singleton_lock" {{(pid=71969) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 14:39:24 devstack cinder-volume[71969]: DEBUG oslo_concurrency.lockutils [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Acquired lock "singleton_lock" {{(pid=71969) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 14:39:24 devstack cinder-volume[71969]: DEBUG oslo_concurrency.lockutils [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Releasing lock "singleton_lock" {{(pid=71969) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 14:39:24 devstack cinder-volume[71969]: WARNING amqp [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 14:39:24 devstack cinder-volume[71969]: WARNING amqp [None req-f5c5062b-912b-4faf-8ede-a127c65b5dc3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 14:39:24 devstack cinder-volume[80912]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80912) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 14:39:24 devstack cinder-volume[80912]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80912) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 14:39:24 devstack cinder-volume[80912]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80912) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 14:39:24 devstack cinder-volume[80912]: INFO dbcounter [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Registered counter for database cinder
Apr 24 14:39:24 devstack cinder-volume[80912]: DEBUG oslo_db.sqlalchemy.engines [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80912) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG dbcounter [-] [80912] Writer thread running {{(pid=80912) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 14:39:25 devstack cinder-volume[80912]: INFO cinder.rpc [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 24 14:39:25 devstack cinder-volume[80912]: INFO cinder.rpc [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_db.sqlalchemy.engines [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80912) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:39:25 devstack cinder-volume[80912]: INFO cinder.volume.manager [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Determined volume DB was empty at startup.
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG cinder.volume.manager [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80912) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 24 14:39:25 devstack cinder-volume[80912]: INFO cinder.volume.manager [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 24 14:39:25 devstack cinder-volume[80912]: WARNING stevedore.named [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 14:39:25 devstack cinder-volume[80912]: WARNING castellan.key_manager [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 14:39:25 devstack cinder-volume[80912]: WARNING cinder.keymgr.conf_key_mgr [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 14:39:25 devstack cinder-volume[80912]: INFO cinder.volume.manager [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_db.sqlalchemy.engines [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80912) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:39:25 devstack cinder-volume[80912]: INFO oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Starting 1 workers
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Started child 81031 {{(pid=80912) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Full set of CONF: {{(pid=80912) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] ******************************************************************************** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Configuration options gathered from: {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] ================================================================================ {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] allow_availability_zone_fallback = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] allow_compression_on_image_upload = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] allowed_direct_url_schemes     = [] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] api_rate_limit                 = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] auth_strategy                  = keystone {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_availability_zone      = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_host                   = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_name                   = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_stats_polling_interval = 60 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backup_api_class               = cinder.backup.api.API {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backup_name_template           = backup-%s {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backup_use_same_host           = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backup_use_temp_snapshot       = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] chap_password                  = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] chap_username                  =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cinder_internal_tenant_project_id = ca10a348366641dcb3b631933306f5bc {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cinder_internal_tenant_user_id = bcc4d7410cce441aac1ef0d270179dfe {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cluster                        = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] compression_format             = gzip {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] compute_api_class              = cinder.compute.nova.API {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] config_dir                     = [] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] config_source                  = [] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] control_exchange               = openstack {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] debug                          = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] default_availability_zone      = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] default_group_type             = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] default_volume_type            = QuobyteHD {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] disk_geometry                  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] driver_client_cert             = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] driver_client_cert_key         = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] driver_data_namespace          = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] driver_ssl_cert_path           = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] driver_ssl_cert_verify         = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] driver_use_ssl                 = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] enable_new_services            = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] enable_unsupported_driver      = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] enabled_backends               = ['QuobyteHD'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] enforce_multipath_for_image_xfer = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] filter_function                = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance_api_insecure            = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance_api_servers             = ['http://192.168.122.34/image'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance_api_ssl_compression     = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance_ca_certificates_file    = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance_catalog_info            = image:glance:publicURL {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance_certfile                = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance_keyfile                 = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance_num_retries             = 3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance_request_timeout         = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] goodness_function              = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] graceful_shutdown_timeout      = 5 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] group_api_class                = cinder.group.api.API {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] host                           = devstack {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] image_compress_on_upload       = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] image_conversion_address_space_limit = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] image_conversion_cpu_limit     = 60 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] image_conversion_disable       = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] image_upload_use_cinder_backend = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] image_upload_use_internal_tenant = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] image_volume_cache_enabled     = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] image_volume_cache_max_count   = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] image_volume_cache_max_size_gb = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] init_host_max_objects_retrieval = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] instance_format                = [instance: %(uuid)s]  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] iscsi_target_flags             =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] iscsi_write_cache              = on {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] iser_helper                    = tgtadm {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] iser_ip_address                = 192.168.122.34 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] iser_port                      = 3260 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] log_color                      = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] log_config_append              = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] log_dir                        = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] log_file                       = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] log_options                    = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] log_rotate_interval            = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] log_rotate_interval_type       = days {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] log_rotation_type              = none {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] max_age                        = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] max_logfile_count              = 30 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] max_logfile_size_mb            = 200 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] max_over_subscription_ratio    = 20.0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] message_reap_interval          = 86400 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] message_ttl                    = 2592000 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] migration_create_volume_timeout_secs = 300 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] monkey_patch                   = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] monkey_patch_modules           = [] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] my_ip                          = 192.168.122.34 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] no_snapshot_gb_quota           = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] num_iser_scan_tries            = 3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] num_shell_tries                = 3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] num_volume_device_scan_tries   = 3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] nvmeof_conn_info_version       = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] nvmet_ns_id                    = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] nvmet_port_id                  = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] osapi_max_limit                = 1000 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] osapi_volume_ext_list          = [] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] osapi_volume_listen_port       = 8776 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] osapi_volume_use_ssl           = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] osapi_volume_workers           = 2 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] per_volume_size_limit          = -1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] periodic_fuzzy_delay           = 60 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] periodic_interval              = 60 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] public_endpoint                = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] publish_errors                 = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] quota_backup_gigabytes         = 1000 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] quota_backups                  = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] quota_gigabytes                = 1000 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] quota_groups                   = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] quota_snapshots                = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] quota_volumes                  = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] rate_limit_burst               = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] rate_limit_except_level        = CRITICAL {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] rate_limit_interval            = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] reinit_driver_count            = 3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] replication_device             = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] report_discard_supported       = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] report_interval                = 120 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] reservation_clean_interval     = 86400 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] reservation_expire             = 86400 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] reserved_image_namespaces      = [] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] reserved_percentage            = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] rpc_response_timeout           = 120 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] run_external_periodic_tasks    = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] scst_target_driver             = iscsi {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] scst_target_iqn_name           = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] service_down_time              = 720 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] shell_completion               = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] snapshot_name_template         = snapshot-%s {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] split_loggers                  = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] state_path                     = /opt/stack/data/cinder {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] storage_availability_zone      = nova {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[81031]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] storage_protocol               = iSCSI {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] syslog_log_facility            = LOG_USER {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] target_helper                  = lioadm {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] target_ip_address              = 192.168.122.34 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] target_port                    = 3260 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] target_protocol                = iscsi {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] target_secondary_ip_addresses  = [] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] trace_flags                    = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] transport_url                  = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] until_refresh                  = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] use_chap_auth                  = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] use_default_quota_class        = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] use_journal                    = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] use_json                       = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] use_multipath_for_image_xfer   = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] use_stderr                     = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] use_syslog                     = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] verify_glance_signatures       = enabled {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_api_class               = cinder.volume.api.API {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_backend_name            = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_clear                   = zero {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_clear_ionice            = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_clear_size              = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_copy_bps_limit          = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_dd_blocksize            = 1M {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_name_template           = volume-%s {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_service_inithost_offload = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volume_usage_audit_period      = month {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] zoning_mode                    = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_concurrency.disable_process_locking = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.admin_password = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.admin_token = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.admin_user  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.auth_admin_prefix =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.auth_port   = 35357 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.auth_protocol = https {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.auth_section = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.auth_type   = password {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.auth_uri    = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.auth_version = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.cache       = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.certfile    = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.delay_auth_decision = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.http_connect_timeout = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.identity_uri = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.include_service_catalog = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.insecure    = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.interface   = public {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.keyfile     = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_password =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcache_username =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.region_name = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.service_token_roles_required = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.service_type = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.token_cache_time = 300 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.backend                  = dogpile.cache.null {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.backend_argument         = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.backend_expiration_time  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.config_prefix            = cache.oslo {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.debug_cache_backend      = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.enable_retry_client      = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.enable_socket_keepalive  = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.enabled                  = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.enforce_fips_mode        = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.expiration_time          = 600 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.hashclient_retry_attempts = 2 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.memcache_dead_retry      = 300 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.memcache_pool_maxsize    = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.memcache_sasl_enabled    = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.password                 = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[81031]: INFO cinder.volume.manager [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 24 14:39:25 devstack cinder-volume[81031]: DEBUG cinder.volume.drivers.remotefs [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81031) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.proxies                  = [] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.redis_db                 = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.redis_sentinel_service_name = mymaster {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.redis_server             = localhost:6379 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.retry_attempts           = 2 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.retry_delay              = 0.0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.socket_keepalive_count   = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.socket_keepalive_idle    = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.socket_keepalive_interval = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.socket_timeout           = 1.0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.tls_allowed_ciphers      = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.tls_cafile               = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.tls_certfile             = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.tls_enabled              = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.tls_keyfile              = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cache.username                 = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] coordination.backend_url       = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.asyncio_connection    = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.asyncio_slave_connection = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.backend               = sqlalchemy {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.connection            = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.connection_debug      = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.connection_parameters =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.connection_recycle_time = 3600 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.connection_trace      = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.db_inc_retry_interval = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.db_max_retries        = 20 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.db_max_retry_interval = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.db_retry_interval     = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.max_overflow          = 50 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.max_pool_size         = 5 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.max_retries           = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.mysql_wsrep_sync_wait = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.pool_timeout          = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.retry_interval        = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.slave_connection      = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.sqlite_synchronous    = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.synchronous_reader    = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] database.use_db_reconnect      = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler.connection_string     = messaging:// {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler.enabled               = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler.es_doc_type           = notification {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler.es_scroll_size        = 10000 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler.es_scroll_time        = 2m {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler.filter_error_trace    = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler.hmac_keys             = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler.sentinel_service_name = mymaster {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler.socket_timeout        = 0.1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler.trace_requests        = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler.trace_sqlalchemy      = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler_jaeger.process_tags   = {} {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler_jaeger.service_name_prefix = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] profiler_otlp.service_name_prefix = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_policy.enforce_new_defaults = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: WARNING oslo_config.cfg [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_policy.enforce_scope      = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_policy.policy_default_rule = default {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_policy.policy_file        = policy.yaml {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] privsep_osbrick.group          = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] privsep_osbrick.helper_command = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] privsep_osbrick.user           = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cinder_sys_admin.group         = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cinder_sys_admin.helper_command = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] cinder_sys_admin.user          = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] service_user.auth_section      = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] service_user.auth_type         = password {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] service_user.cafile            = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] service_user.certfile          = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] service_user.collect_timing    = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] service_user.insecure          = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] service_user.keyfile           = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] service_user.send_service_user_token = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] service_user.split_loggers     = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] service_user.timeout           = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance.auth_section            = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance.auth_type               = password {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance.certfile                = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance.collect_timing          = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance.insecure                = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance.keyfile                 = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance.region_name             = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance.split_loggers           = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] glance.timeout                 = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.backend_availability_zone = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.chap_password = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.chap_username =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.disk_geometry = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.driver_client_cert = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.driver_client_cert_key = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.driver_data_namespace = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.driver_use_ssl = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.enable_unsupported_driver = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.extra_capabilities = {} {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.filter_function = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.goodness_function = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.iscsi_target_flags =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.iscsi_write_cache = on {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.iser_helper   = tgtadm {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[81031]: DEBUG cinder.volume.drivers.quobyte [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81031) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 24 14:39:25 devstack cinder-volume[81031]: WARNING cinder.volume.drivers.quobyte [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 24 14:39:25 devstack cinder-volume[81031]: WARNING cinder.volume.drivers.quobyte [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 24 14:39:25 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Running cmd (subprocess): mount.quobyte {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.iser_port     = 3260 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nas_host      =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nas_login     = admin {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nas_mount_options = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nas_password  = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nas_private_key =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nas_share_path =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.num_shell_tries = 3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.nvmet_port_id = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.quobyte_client_cfg = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.quobyte_volume_url = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.replication_device = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.report_discard_supported = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.reserved_percentage = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.scst_target_driver = iscsi {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.scst_target_iqn_name = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.storage_protocol = iSCSI {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.target_helper = tgtadm {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.target_port   = 3260 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.target_protocol = iscsi {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.trace_flags   = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.unique_fqdn_network = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.use_chap_auth = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.volume_backend_name = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.volume_clear  = zero {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.volume_clear_ionice = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.volume_clear_size = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_reports.file_event_handler = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_reports.log_dir           = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.backend_availability_zone = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.backend_host         = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.chap_password        = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.chap_username        = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.chiscsi_conf         = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.disk_geometry        = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.driver_client_cert   = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.driver_client_cert_key = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.driver_data_namespace = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.driver_use_ssl       = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.extra_capabilities   = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.filter_function      = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.goodness_function    = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.iser_helper          = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.iser_ip_address      = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.iser_port            = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.iser_target_prefix   = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nas_host             = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nas_login            = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nas_mount_options    = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nas_password         = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nas_private_key      = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nas_share_path       = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nas_ssh_port         = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.num_shell_tries      = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.nvmet_port_id        = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.replication_device   = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.report_discard_supported = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.reserved_percentage  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.scst_target_driver   = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.storage_protocol     = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.target_helper        = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.target_ip_address    = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.target_port          = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.target_prefix        = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.target_protocol      = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.trace_flags          = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.use_chap_auth        = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.volume_clear         = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.volume_clear_size    = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] QuobyteHD.volumes_dir          = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.ssl      = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_notifications.driver = [] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_notifications.retry = -1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] oslo_messaging_notifications.transport_url = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] key_manager.fixed_key          = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.barbican_api_version  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.barbican_endpoint     = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.barbican_endpoint_type = public {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.barbican_region_name  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.cafile                = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.certfile              = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.collect_timing        = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.insecure              = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.keyfile               = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.number_of_retries     = 60 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.retry_delay           = 1 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.send_service_user_token = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.split_loggers         = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.timeout               = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.verify_ssl            = True {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican.verify_ssl_path       = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican_service_user.auth_section = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican_service_user.auth_type = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican_service_user.cafile   = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican_service_user.certfile = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican_service_user.collect_timing = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican_service_user.insecure = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican_service_user.keyfile  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican_service_user.split_loggers = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] barbican_service_user.timeout  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vault.approle_role_id          = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vault.approle_secret_id        = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vault.kv_mountpoint            = secret {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vault.kv_path                  = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vault.kv_version               = 2 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vault.namespace                = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vault.root_token_id            = **** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vault.ssl_ca_crt_file          = None {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vault.timeout                  = 60.0 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vault.use_ssl                  = False {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:25 devstack quobyte-client[81032]: Reading configuration file: /etc/quobyte/client.cfg
Apr 24 14:39:25 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] ******************************************************************************** {{(pid=80912) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 24 14:39:25 devstack quobyte-client[81032]: Invalid parameters found, error: missing mount point.
Apr 24 14:39:25 devstack quobyte-client[81032]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 24 14:39:25 devstack quobyte-client[81032]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 24 14:39:25 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] CMD "mount.quobyte" returned: 1 in 0.129s {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:25 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:39:25 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:39:25 devstack cinder-volume[81031]: DEBUG cinder.volume.drivers.quobyte [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81031) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:39:25 devstack cinder-volume[81031]: INFO cinder.volume.drivers.quobyte [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d ...
Apr 24 14:39:25 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca -c /etc/quobyte/client-cinder.cfg {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:25 devstack sudo[81033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca -c /etc/quobyte/client-cinder.cfg
Apr 24 14:39:25 devstack sudo[81033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:26 devstack sudo[81033]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:26 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.648s {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:26 devstack cinder-volume[81031]: INFO cinder.volume.drivers.quobyte [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d succeeded
Apr 24 14:39:26 devstack cinder-volume[81031]: DEBUG cinder.volume.drivers.quobyte [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81031) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:39:26 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.665s {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:39:26 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:26 devstack sudo[81126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:39:26 devstack sudo[81126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:27 devstack sudo[81126]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.715s {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:27 devstack cinder-volume[81031]: INFO cinder.volume.driver [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Driver hasn't implemented _init_vendor_properties()
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG cinder.volume.driver [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6256141662598, 'free_capacity_gb': 1775.6256141662598, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81031) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG oslo_db.sqlalchemy.engines [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG dbcounter [-] [81031] Writer thread running {{(pid=81031) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG cinder.db.sqlalchemy.api [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Building query based on filter {{(pid=81031) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG cinder.image.image_utils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81031) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 24 14:39:27 devstack cinder-volume[81031]: INFO cinder.keymgr.migration [None req-257659e2-3290-46b9-a0bc-5bf06980d24f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG cinder.volume.drivers.quobyte [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81031) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG cinder.volume.drivers.quobyte [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81031) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:27 devstack sudo[81164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:39:27 devstack sudo[81164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:27 devstack sudo[81164]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.464s {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG cinder.manager [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Notifying Schedulers of capabilities ... {{(pid=81031) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:39:27 devstack cinder-volume[81031]: INFO cinder.volume.manager [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Driver initialization completed successfully.
Apr 24 14:39:27 devstack cinder-volume[81031]: INFO cinder.manager [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Initiating service 3 cleanup
Apr 24 14:39:27 devstack cinder-volume[81031]: INFO cinder.manager [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Service 3 cleanup completed.
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG cinder.service [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Creating RPC server for service cinder-volume {{(pid=81031) start /opt/stack/cinder/cinder/service.py:231}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG cinder.service [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81031) start /opt/stack/cinder/cinder/service.py:237}}
Apr 24 14:39:27 devstack cinder-volume[81031]: INFO cinder.volume.manager [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG cinder.volume.drivers.quobyte [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81031) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG cinder.volume.drivers.quobyte [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81031) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:39:27 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:27 devstack sudo[81170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:39:27 devstack sudo[81170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:28 devstack sudo[81170]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:28 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.541s {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:28 devstack cinder-volume[81031]: INFO cinder.volume.manager [None req-e97a89c4-7527-47d8-b3ec-9556f192d57c None None] Driver post RPC initialization completed successfully.
Apr 24 14:39:29 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-fdbf5446-7437-4da2-b693-02882991ebab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:39:29 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-fdbf5446-7437-4da2-b693-02882991ebab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:39:29 devstack cinder-volume[81031]: DEBUG cinder.volume.drivers.quobyte [None req-fdbf5446-7437-4da2-b693-02882991ebab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81031) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:39:29 devstack cinder-volume[81031]: DEBUG cinder.volume.drivers.quobyte [None req-fdbf5446-7437-4da2-b693-02882991ebab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81031) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:39:29 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-fdbf5446-7437-4da2-b693-02882991ebab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81031) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:39:29 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-fdbf5446-7437-4da2-b693-02882991ebab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:29 devstack sudo[81175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:39:29 devstack sudo[81175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:29 devstack sudo[81175]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:29 devstack cinder-volume[81031]: DEBUG oslo_concurrency.processutils [None req-fdbf5446-7437-4da2-b693-02882991ebab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.441s {{(pid=81031) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:29 devstack cinder-volume[81031]: DEBUG cinder.manager [None req-fdbf5446-7437-4da2-b693-02882991ebab None None] Notifying Schedulers of capabilities ... {{(pid=81031) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:39:33 devstack cinder-volume[80912]: INFO oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Caught SIGTERM, stopping children
Apr 24 14:39:33 devstack cinder-volume[80912]: DEBUG oslo_concurrency.lockutils [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Acquiring lock "singleton_lock" {{(pid=80912) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 14:39:33 devstack cinder-volume[80912]: DEBUG oslo_concurrency.lockutils [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Acquired lock "singleton_lock" {{(pid=80912) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 14:39:33 devstack cinder-volume[80912]: DEBUG oslo_concurrency.lockutils [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Releasing lock "singleton_lock" {{(pid=80912) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 14:39:33 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Stop services. {{(pid=80912) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 24 14:39:33 devstack cinder-volume[80912]: DEBUG oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Killing children. {{(pid=80912) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 24 14:39:33 devstack cinder-volume[80912]: INFO oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Waiting on 1 children to exit
Apr 24 14:39:35 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Acquiring lock "singleton_lock" {{(pid=81031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 14:39:35 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Acquired lock "singleton_lock" {{(pid=81031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 14:39:35 devstack cinder-volume[81031]: DEBUG oslo_concurrency.lockutils [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Releasing lock "singleton_lock" {{(pid=81031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 14:39:35 devstack cinder-volume[81031]: WARNING amqp [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 14:39:35 devstack cinder-volume[81031]: WARNING amqp [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 24 14:39:35 devstack cinder-volume[80912]: INFO oslo_service.backend._eventlet.service [None req-c8a9abba-7d03-423b-8546-7420d1c7cb3c None None] Child 81031 exited with status 0
Apr 24 14:39:36 devstack cinder-volume[81290]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 24 14:39:36 devstack cinder-volume[81290]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 14:39:36 devstack cinder-volume[81290]: we strongly recommend against using it for new projects.
Apr 24 14:39:36 devstack cinder-volume[81290]: If you are already using Eventlet, we recommend migrating to a different
Apr 24 14:39:36 devstack cinder-volume[81290]: framework.  For more detail see
Apr 24 14:39:36 devstack cinder-volume[81290]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 14:39:36 devstack cinder-volume[81290]:   import eventlet  # noqa
Apr 24 14:39:38 devstack cinder-volume[81290]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 24 14:39:38 devstack cinder-volume[81290]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 24 14:39:38 devstack cinder-volume[81290]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 24 14:39:39 devstack cinder-volume[81290]: INFO dbcounter [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Registered counter for database cinder
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_db.sqlalchemy.engines [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG dbcounter [-] [81290] Writer thread running {{(pid=81290) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 14:39:39 devstack cinder-volume[81290]: INFO cinder.rpc [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 24 14:39:39 devstack cinder-volume[81290]: INFO cinder.rpc [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_db.sqlalchemy.engines [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:39:39 devstack cinder-volume[81290]: INFO cinder.volume.manager [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Determined volume DB was empty at startup.
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG cinder.volume.manager [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81290) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 24 14:39:39 devstack cinder-volume[81290]: WARNING stevedore.named [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 24 14:39:39 devstack cinder-volume[81290]: WARNING castellan.key_manager [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 14:39:39 devstack cinder-volume[81290]: WARNING cinder.keymgr.conf_key_mgr [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 24 14:39:39 devstack cinder-volume[81290]: INFO cinder.volume.manager [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_db.sqlalchemy.engines [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:39:39 devstack cinder-volume[81290]: INFO oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Starting 1 workers
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Started child 81510 {{(pid=81290) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Full set of CONF: {{(pid=81290) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] ******************************************************************************** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Configuration options gathered from: {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] ================================================================================ {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] allow_availability_zone_fallback = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] allow_compression_on_image_upload = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81510]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] allowed_direct_url_schemes     = [] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] api_rate_limit                 = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] auth_strategy                  = keystone {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_availability_zone      = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_host                   = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_name                   = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_stats_polling_interval = 60 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backup_api_class               = cinder.backup.api.API {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backup_name_template           = backup-%s {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backup_use_same_host           = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backup_use_temp_snapshot       = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] chap_password                  = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] chap_username                  =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cinder_internal_tenant_project_id = ca10a348366641dcb3b631933306f5bc {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cinder_internal_tenant_user_id = bcc4d7410cce441aac1ef0d270179dfe {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cluster                        = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] compression_format             = gzip {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] config_dir                     = [] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] config_source                  = [] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] control_exchange               = openstack {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] debug                          = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] default_availability_zone      = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] default_group_type             = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] default_volume_type            = QuobyteHD {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] disk_geometry                  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] driver_client_cert             = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] driver_client_cert_key         = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] driver_data_namespace          = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] driver_ssl_cert_path           = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] driver_ssl_cert_verify         = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] driver_use_ssl                 = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] enable_new_services            = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] enable_unsupported_driver      = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] enforce_multipath_for_image_xfer = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] filter_function                = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance_api_insecure            = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance_api_servers             = ['http://192.168.122.34/image'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance_api_ssl_compression     = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance_ca_certificates_file    = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance_certfile                = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance_keyfile                 = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance_num_retries             = 3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance_request_timeout         = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] goodness_function              = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] graceful_shutdown_timeout      = 5 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] group_api_class                = cinder.group.api.API {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] host                           = devstack {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] image_compress_on_upload       = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] image_conversion_address_space_limit = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] image_conversion_cpu_limit     = 60 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] image_conversion_disable       = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] image_upload_use_cinder_backend = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] image_upload_use_internal_tenant = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] image_volume_cache_enabled     = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] image_volume_cache_max_count   = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] image_volume_cache_max_size_gb = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] init_host_max_objects_retrieval = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] iscsi_target_flags             =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] iscsi_write_cache              = on {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] iser_helper                    = tgtadm {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] iser_ip_address                = 192.168.122.34 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] iser_port                      = 3260 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] log_color                      = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] log_config_append              = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] log_dir                        = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] log_file                       = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] log_options                    = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] log_rotate_interval            = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] log_rotate_interval_type       = days {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] log_rotation_type              = none {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 24 14:39:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81510) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] max_age                        = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] max_logfile_count              = 30 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] max_logfile_size_mb            = 200 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] max_over_subscription_ratio    = 20.0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] message_reap_interval          = 86400 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] message_ttl                    = 2592000 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] migration_create_volume_timeout_secs = 300 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] monkey_patch                   = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] monkey_patch_modules           = [] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] my_ip                          = 192.168.122.34 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] no_snapshot_gb_quota           = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] num_iser_scan_tries            = 3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] num_shell_tries                = 3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] num_volume_device_scan_tries   = 3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] nvmeof_conn_info_version       = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] nvmet_ns_id                    = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] nvmet_port_id                  = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] osapi_max_limit                = 1000 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] osapi_volume_ext_list          = [] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] osapi_volume_listen_port       = 8776 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] osapi_volume_use_ssl           = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] osapi_volume_workers           = 2 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] per_volume_size_limit          = -1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] periodic_fuzzy_delay           = 60 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] periodic_interval              = 60 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] public_endpoint                = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] publish_errors                 = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] quota_backup_gigabytes         = 1000 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] quota_backups                  = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] quota_gigabytes                = 1000 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] quota_groups                   = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] quota_snapshots                = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] quota_volumes                  = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] rate_limit_burst               = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] rate_limit_except_level        = CRITICAL {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] rate_limit_interval            = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] reinit_driver_count            = 3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] replication_device             = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] report_discard_supported       = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] report_interval                = 120 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] reservation_clean_interval     = 86400 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] reservation_expire             = 86400 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] reserved_image_namespaces      = [] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] reserved_percentage            = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] rpc_response_timeout           = 120 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] run_external_periodic_tasks    = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] scst_target_driver             = iscsi {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] scst_target_iqn_name           = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] service_down_time              = 720 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] shell_completion               = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] snapshot_name_template         = snapshot-%s {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] split_loggers                  = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] state_path                     = /opt/stack/data/cinder {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] storage_availability_zone      = nova {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] storage_protocol               = iSCSI {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] syslog_log_facility            = LOG_USER {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] target_helper                  = lioadm {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] target_ip_address              = 192.168.122.34 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] target_port                    = 3260 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] target_protocol                = iscsi {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] target_secondary_ip_addresses  = [] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] trace_flags                    = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] transport_url                  = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] until_refresh                  = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] use_chap_auth                  = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] use_default_quota_class        = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] use_journal                    = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] use_json                       = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] use_multipath_for_image_xfer   = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] use_stderr                     = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] use_syslog                     = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] verify_glance_signatures       = enabled {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_api_class               = cinder.volume.api.API {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_backend_name            = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_clear                   = zero {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_clear_ionice            = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_clear_size              = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_copy_bps_limit          = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_dd_blocksize            = 1M {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_name_template           = volume-%s {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_service_inithost_offload = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volume_usage_audit_period      = month {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] zoning_mode                    = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_concurrency.disable_process_locking = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.admin_password = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.admin_token = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.admin_user  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.auth_protocol = https {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.auth_section = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.auth_type   = password {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.auth_uri    = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.auth_version = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.cache       = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.certfile    = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.identity_uri = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.include_service_catalog = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.insecure    = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.interface   = public {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.keyfile     = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_password =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81510) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 24 14:39:39 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.quobyte [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 24 14:39:39 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.quobyte [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Running cmd (subprocess): mount.quobyte {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcache_username =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.region_name = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.service_type = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.backend                  = dogpile.cache.null {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.backend_argument         = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.backend_expiration_time  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.config_prefix            = cache.oslo {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.debug_cache_backend      = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.enable_retry_client      = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.enable_socket_keepalive  = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.enabled                  = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.enforce_fips_mode        = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.expiration_time          = 600 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.hashclient_retry_attempts = 2 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.memcache_dead_retry      = 300 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.memcache_sasl_enabled    = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.password                 = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.proxies                  = [] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.redis_db                 = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.redis_server             = localhost:6379 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.retry_attempts           = 2 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.retry_delay              = 0.0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.socket_keepalive_count   = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.socket_keepalive_idle    = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.socket_keepalive_interval = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.socket_timeout           = 1.0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.tls_allowed_ciphers      = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.tls_cafile               = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.tls_certfile             = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.tls_enabled              = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.tls_keyfile              = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cache.username                 = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] coordination.backend_url       = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.asyncio_connection    = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.asyncio_slave_connection = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.backend               = sqlalchemy {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.connection            = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.connection_debug      = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.connection_parameters =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.connection_recycle_time = 3600 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.connection_trace      = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.db_inc_retry_interval = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.db_max_retries        = 20 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.db_max_retry_interval = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.db_retry_interval     = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.max_overflow          = 50 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.max_pool_size         = 5 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.max_retries           = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.mysql_wsrep_sync_wait = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.pool_timeout          = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.retry_interval        = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.slave_connection      = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.sqlite_synchronous    = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.synchronous_reader    = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] database.use_db_reconnect      = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler.connection_string     = messaging:// {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler.enabled               = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler.es_doc_type           = notification {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler.es_scroll_size        = 10000 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler.es_scroll_time        = 2m {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler.filter_error_trace    = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler.hmac_keys             = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler.sentinel_service_name = mymaster {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler.socket_timeout        = 0.1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler.trace_requests        = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler.trace_sqlalchemy      = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler_jaeger.process_tags   = {} {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler_jaeger.service_name_prefix = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] profiler_otlp.service_name_prefix = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_policy.enforce_new_defaults = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: WARNING oslo_config.cfg [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_policy.enforce_scope      = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_policy.policy_default_rule = default {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] privsep_osbrick.group          = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] privsep_osbrick.helper_command = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] privsep_osbrick.user           = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cinder_sys_admin.group         = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cinder_sys_admin.helper_command = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] cinder_sys_admin.user          = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] service_user.auth_section      = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] service_user.auth_type         = password {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] service_user.cafile            = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] service_user.certfile          = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] service_user.collect_timing    = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] service_user.insecure          = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] service_user.keyfile           = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] service_user.send_service_user_token = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] service_user.split_loggers     = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] service_user.timeout           = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance.auth_section            = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance.auth_type               = password {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance.certfile                = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance.collect_timing          = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance.insecure                = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance.keyfile                 = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance.region_name             = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance.split_loggers           = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] glance.timeout                 = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.backend_availability_zone = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.chap_password = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.chap_username =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.disk_geometry = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.driver_client_cert = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.driver_client_cert_key = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.driver_data_namespace = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.driver_use_ssl = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.extra_capabilities = {} {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.filter_function = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.goodness_function = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.iscsi_target_flags =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.iscsi_write_cache = on {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.iser_port     = 3260 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack quobyte-client[81521]: Reading configuration file: /etc/quobyte/client.cfg
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nas_host      =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nas_login     = admin {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nas_mount_options = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nas_password  = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nas_private_key =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack quobyte-client[81521]: Invalid parameters found, error: missing mount point.
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nas_share_path =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.num_shell_tries = 3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack quobyte-client[81521]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack quobyte-client[81521]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 24 14:39:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.quobyte_volume_url = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.replication_device = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.report_discard_supported = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.reserved_percentage = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.target_helper = tgtadm {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.target_port   = 3260 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.target_protocol = iscsi {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.trace_flags   = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.unique_fqdn_network = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.use_chap_auth = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.volume_backend_name = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.volume_clear  = zero {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.volume_clear_ionice = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.volume_clear_size = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_reports.file_event_handler = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_reports.log_dir           = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.backend_availability_zone = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.backend_host         = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.chap_password        = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.chap_username        = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.disk_geometry        = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.driver_client_cert   = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.driver_data_namespace = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.extra_capabilities   = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.filter_function      = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.goodness_function    = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.iser_helper          = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.iser_ip_address      = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.iser_port            = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nas_host             = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nas_login            = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nas_mount_options    = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nas_password         = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nas_private_key      = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nas_share_path       = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack sudo[81522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.num_shell_tries      = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack sudo[81522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.replication_device   = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.report_discard_supported = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.reserved_percentage  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.scst_target_driver   = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.storage_protocol     = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.target_helper        = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.target_ip_address    = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.target_port          = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.target_prefix        = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.target_protocol      = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.trace_flags          = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.use_chap_auth        = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.volume_clear         = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.volume_clear_size    = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] QuobyteHD.volumes_dir          = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_notifications.driver = [] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_notifications.retry = -1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] key_manager.fixed_key          = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.barbican_api_version  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.barbican_endpoint     = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.barbican_endpoint_type = public {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.barbican_region_name  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.cafile                = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.certfile              = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.collect_timing        = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.insecure              = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.keyfile               = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.number_of_retries     = 60 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.retry_delay           = 1 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.send_service_user_token = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.split_loggers         = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.timeout               = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.verify_ssl            = True {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican.verify_ssl_path       = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican_service_user.auth_section = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican_service_user.auth_type = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican_service_user.cafile   = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican_service_user.certfile = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican_service_user.collect_timing = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican_service_user.insecure = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican_service_user.keyfile  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican_service_user.split_loggers = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] barbican_service_user.timeout  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vault.approle_role_id          = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vault.approle_secret_id        = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vault.kv_mountpoint            = secret {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vault.kv_path                  = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vault.kv_version               = 2 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vault.namespace                = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vault.root_token_id            = **** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vault.ssl_ca_crt_file          = None {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vault.timeout                  = 60.0 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vault.use_ssl                  = False {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 24 14:39:39 devstack cinder-volume[81290]: DEBUG oslo_service.backend._eventlet.service [None req-346f3750-764f-4602-93c6-849aa2d92521 None None] ******************************************************************************** {{(pid=81290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 24 14:39:40 devstack sudo[81522]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.487s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:40 devstack cinder-volume[81510]: INFO cinder.volume.driver [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Driver hasn't implemented _init_vendor_properties()
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG cinder.volume.driver [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6256141662598, 'free_capacity_gb': 1775.6256141662598, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81510) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG oslo_db.sqlalchemy.engines [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writer thread running {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG cinder.db.sqlalchemy.api [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Building query based on filter {{(pid=81510) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81510) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:40 devstack cinder-volume[81510]: INFO cinder.keymgr.migration [None req-908fee2d-0d40-4048-9d0f-850dcfdc2e80 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 24 14:39:40 devstack sudo[81537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:39:40 devstack sudo[81537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:40 devstack sudo[81537]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.434s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:39:40 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Driver initialization completed successfully.
Apr 24 14:39:40 devstack cinder-volume[81510]: INFO cinder.manager [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Initiating service 3 cleanup
Apr 24 14:39:40 devstack cinder-volume[81510]: INFO cinder.manager [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Service 3 cleanup completed.
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG cinder.service [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Creating RPC server for service cinder-volume {{(pid=81510) start /opt/stack/cinder/cinder/service.py:231}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG cinder.service [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81510) start /opt/stack/cinder/cinder/service.py:237}}
Apr 24 14:39:40 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:39:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:39:40 devstack sudo[81542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:39:40 devstack sudo[81542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:39:41 devstack sudo[81542]: pam_unix(sudo:session): session closed for user root
Apr 24 14:39:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.464s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:39:41 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ccd31c32-388f-4ed8-9eb3-5ee243e871d9 None None] Driver post RPC initialization completed successfully.
Apr 24 14:39:49 devstack cinder-volume[81290]: DEBUG dbcounter [-] [81290] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81290) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:39:50 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=1 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:39:51 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:40:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:40:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:40:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:40:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:40:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:40:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:40:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:40:43 devstack sudo[81754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:40:43 devstack sudo[81754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:40:43 devstack sudo[81754]: pam_unix(sudo:session): session closed for user root
Apr 24 14:40:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.610s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:40:43 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:41:11 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:41:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Flow 'volume_create_manager' (19a808d7-eb4d-4331-a73d-7eefb62742cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:41:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17951842-2ae4-42db-a5f4-c9a71633057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17951842-2ae4-42db-a5f4-c9a71633057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1344885404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4ac486-44de-4046-ad12-742c229530d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496a01bff7a94bf58a0234f70df785f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:41:11Z,use_quota=True,user_id='e9dd6c6df9df49cca91c153fc02ec21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e6047c-94a4-4934-b2c0-4af6bfcb6a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e6047c-94a4-4934-b2c0-4af6bfcb6a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e294956e-b192-4186-a980-3e747db30821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e294956e-b192-4186-a980-3e747db30821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4ac486-44de-4046-ad12-742c229530d8', 'volume_name': 'volume-ce4ac486-44de-4046-ad12-742c229530d8', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4151c0-aba0-49a2-afe6-95541f6ae5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4151c0-aba0-49a2-afe6-95541f6ae5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bc25df-57b6-40cc-8fe2-daf0c6904ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:11 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Volume ce4ac486-44de-4046-ad12-742c229530d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4ac486-44de-4046-ad12-742c229530d8', 'volume_size': 1}
Apr 24 14:41:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1344885404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4ac486-44de-4046-ad12-742c229530d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496a01bff7a94bf58a0234f70df785f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:41:11Z,use_quota=True,user_id='e9dd6c6df9df49cca91c153fc02ec21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:41:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Creating volume ce4ac486-44de-4046-ad12-742c229530d8 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:41:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:41:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:41:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:41:12 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:41:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:12 devstack sudo[82067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8 1073741824
Apr 24 14:41:12 devstack sudo[82067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:15 devstack sudo[82067]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8 1073741824" returned: 0 in 3.815s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:16 devstack sudo[82439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8
Apr 24 14:41:16 devstack sudo[82439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:18 devstack sudo[82439]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8" returned: 0 in 2.224s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] <== create_volume: return (6288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:41:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 6.317s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bc25df-57b6-40cc-8fe2-daf0c6904ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4ac486-44de-4046-ad12-742c229530d8', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62713fa-4340-40c8-a19e-a8a6cdf13e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:18 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Volume volume-ce4ac486-44de-4046-ad12-742c229530d8 (ce4ac486-44de-4046-ad12-742c229530d8): created successfully
Apr 24 14:41:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62713fa-4340-40c8-a19e-a8a6cdf13e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Flow 'volume_create_manager' (19a808d7-eb4d-4331-a73d-7eefb62742cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:41:18 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-15fdfd7a-9021-40f8-8e51-e7de77cd0444 tempest-VolumesAdminNegativeTest-326993989 None] Created volume successfully.
Apr 24 14:41:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Acquiring lock "cinder-ce4ac486-44de-4046-ad12-742c229530d8-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:41:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Lock "cinder-ce4ac486-44de-4046-ad12-742c229530d8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:41:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Acquiring lock "cinder-quobyte-ce4ac486-44de-4046-ad12-742c229530d8" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:41:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Lock "cinder-quobyte-ce4ac486-44de-4046-ad12-742c229530d8" acquired by "delete_volume" :: waited 0.037s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:41:21 devstack cinder-volume[81510]: INFO oslo.privsep.daemon [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphhudnqcp/privsep.sock']
Apr 24 14:41:21 devstack sudo[82572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphhudnqcp/privsep.sock
Apr 24 14:41:21 devstack sudo[82572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Flow 'volume_create_manager' (f4002a3d-65af-4a37-927a-2f9513d8c887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c5b68e-20ac-4135-97be-7a7c766ffe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c5b68e-20ac-4135-97be-7a7c766ffe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1329618709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a61b08-1547-43fe-bed5-0d6ac75ddea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6497770ce104605b7f604c7407b8663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:41:22Z,use_quota=True,user_id='20af719163504edba6127445323dcdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb632b4b-ecc0-4f2a-b6cb-87d413a9b1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb632b4b-ecc0-4f2a-b6cb-87d413a9b1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcb839d-8bdf-4177-925b-797595817b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcb839d-8bdf-4177-925b-797595817b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26a61b08-1547-43fe-bed5-0d6ac75ddea0', 'volume_name': 'volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3054da-2fc0-4a13-8d49-75bb8221550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3054da-2fc0-4a13-8d49-75bb8221550e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31073a4-5d44-48e3-b2fb-3062793c91ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:22 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Volume 26a61b08-1547-43fe-bed5-0d6ac75ddea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0', 'volume_size': 1}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1329618709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a61b08-1547-43fe-bed5-0d6ac75ddea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6497770ce104605b7f604c7407b8663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:41:22Z,use_quota=True,user_id='20af719163504edba6127445323dcdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Creating volume 26a61b08-1547-43fe-bed5-0d6ac75ddea0 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:41:22 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:41:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:22 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 24 14:41:22 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 14:41:22 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 24 14:41:22 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 14:41:22 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 24 14:41:22 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 24 14:41:22 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 14:41:22 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 14:41:22 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 24 14:41:22 devstack sudo[82577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0 1073741824
Apr 24 14:41:22 devstack sudo[82577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:23 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 24 14:41:23 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 14:41:23 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 24 14:41:23 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 14:41:23 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 24 14:41:23 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 24 14:41:23 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 14:41:23 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 24 14:41:23 devstack cinder-volume[81510]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 24 14:41:24 devstack sudo[82577]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0 1073741824" returned: 0 in 1.612s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:24 devstack sudo[82584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0
Apr 24 14:41:24 devstack sudo[82584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:24 devstack sudo[82572]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:24 devstack cinder-volume[81510]: INFO oslo.privsep.daemon [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Spawned new privsep daemon via rootwrap
Apr 24 14:41:24 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Accepted privsep connection to /tmp/tmphhudnqcp/privsep.sock {{(pid=81510) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 24 14:41:24 devstack cinder-volume[81510]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 24 14:41:24 devstack cinder-volume[81510]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 24 14:41:24 devstack cinder-volume[81510]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 24 14:41:24 devstack cinder-volume[81510]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82581
Apr 24 14:41:24 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[274aecf4-e873-42ce-b3fa-877011c7170d]: (2,) {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:41:24 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e11781c-6cb9-4665-89fc-6c185bbb70a5]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:41:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:24 devstack sudo[82587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8
Apr 24 14:41:24 devstack sudo[82587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:25 devstack sudo[82584]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0" returned: 0 in 1.119s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] <== create_volume: return (2790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:41:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.792s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31073a4-5d44-48e3-b2fb-3062793c91ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e79319b-1e4e-47f1-8014-69f2a0993342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:25 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Volume volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0 (26a61b08-1547-43fe-bed5-0d6ac75ddea0): created successfully
Apr 24 14:41:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e79319b-1e4e-47f1-8014-69f2a0993342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Flow 'volume_create_manager' (f4002a3d-65af-4a37-927a-2f9513d8c887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:41:25 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-838ed7ba-f809-4336-af5c-374d32a08ff9 tempest-ServerRescueNegativeTestJSON-1186607925 None] Created volume successfully.
Apr 24 14:41:26 devstack sudo[82587]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8" returned: 0 in 1.775s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:26 devstack sudo[82597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8
Apr 24 14:41:26 devstack sudo[82597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:28 devstack sudo[82597]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ce4ac486-44de-4046-ad12-742c229530d8" returned: 0 in 1.907s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Lock "cinder-quobyte-ce4ac486-44de-4046-ad12-742c229530d8" released by "delete_volume" :: held 6.642s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:41:28 devstack cinder-volume[81510]: WARNING cinder.quota [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:41:28 devstack cinder-volume[81510]: WARNING cinder.quota [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:41:28 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Created reservations ['fbc8f976-d5a1-46e4-9110-268863d7f6ba', '29e2ff18-f2f9-45d2-8ec8-feab5dc98a0f', 'd4f82bda-4710-4681-b5e2-fa5ac94c59bb', '705dfdb8-9f2d-4990-8588-566b6ae20a48'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:41:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:28 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:41:28 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:41:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:28 devstack sudo[82656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:41:28 devstack sudo[82656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:30 devstack sudo[82656]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.238s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:30 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:41:30 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Deleted volume successfully.
Apr 24 14:41:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5e26b31-d53f-4879-b238-4bd882f13848 tempest-VolumesAdminNegativeTest-326993989 None] Lock "cinder-ce4ac486-44de-4046-ad12-742c229530d8-delete_volume" released by "delete_volume" :: held 8.823s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:41:38 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=12 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:41:40 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:UPDATE=16,cinder:DELETE=3,cinder:SELECT=7,cinder:INSERT=4 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Flow 'volume_create_manager' (ff56ec87-50d3-4751-b635-6cc6eaf6d4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3c2701-27f7-4b5f-99fd-18af0d23ec9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3c2701-27f7-4b5f-99fd-18af0d23ec9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1361178816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebb766d-0b1e-46fe-81ae-e77f0cfb4387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb47d59977fc4608af9628f848b9a953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:41:43Z,use_quota=True,user_id='558e89b0f77e46288ed0742cf08ba885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dc9bc1-daf2-4558-94c3-fee86592d96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dc9bc1-daf2-4558-94c3-fee86592d96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50c6b16-047c-4e3b-9914-5975b448378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50c6b16-047c-4e3b-9914-5975b448378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ebb766d-0b1e-46fe-81ae-e77f0cfb4387', 'volume_name': 'volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7bd4e7-df46-4150-8c35-566f6b660f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7bd4e7-df46-4150-8c35-566f6b660f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5832b3e-ca67-45cf-b904-08ba4527fba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:43 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Volume 5ebb766d-0b1e-46fe-81ae-e77f0cfb4387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387', 'volume_size': 1}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1361178816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebb766d-0b1e-46fe-81ae-e77f0cfb4387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb47d59977fc4608af9628f848b9a953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:41:43Z,use_quota=True,user_id='558e89b0f77e46288ed0742cf08ba885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Creating volume 5ebb766d-0b1e-46fe-81ae-e77f0cfb4387 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:41:43 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:43 devstack sudo[82855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387 1073741824
Apr 24 14:41:43 devstack sudo[82855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:43 devstack sudo[82857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:41:43 devstack sudo[82857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:44 devstack sudo[82857]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.808s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:44 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:41:44 devstack sudo[82855]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387 1073741824" returned: 0 in 0.977s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:44 devstack sudo[82864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387
Apr 24 14:41:44 devstack sudo[82864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:45 devstack sudo[82864]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387" returned: 0 in 0.950s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:41:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5832b3e-ca67-45cf-b904-08ba4527fba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f03522b-923b-4959-b2bf-f8fc136c5c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:45 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Volume volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387 (5ebb766d-0b1e-46fe-81ae-e77f0cfb4387): created successfully
Apr 24 14:41:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f03522b-923b-4959-b2bf-f8fc136c5c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Flow 'volume_create_manager' (ff56ec87-50d3-4751-b635-6cc6eaf6d4a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:41:45 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6c3f9482-95e8-4158-a543-400a965596d6 tempest-ServersNegativeTestJSON-471486697 None] Created volume successfully.
Apr 24 14:41:48 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Flow 'volume_create_manager' (bd838efb-6814-4b0c-8422-9dcc47ce5817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6692a3c-4652-4c05-b96a-4eb0c1414199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6692a3c-4652-4c05-b96a-4eb0c1414199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-599558720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7d5872-51f0-4929-b38b-fa8e1908719e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb47d59977fc4608af9628f848b9a953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:41:49Z,use_quota=True,user_id='558e89b0f77e46288ed0742cf08ba885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c835d53b-e597-4059-823b-64edb7053b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c835d53b-e597-4059-823b-64edb7053b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f84ea1-3833-431f-a2ab-22841f5588b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f84ea1-3833-431f-a2ab-22841f5588b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b7d5872-51f0-4929-b38b-fa8e1908719e', 'volume_name': 'volume-5b7d5872-51f0-4929-b38b-fa8e1908719e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dfe8ee-e05f-46ad-ac28-aefa77d1eff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dfe8ee-e05f-46ad-ac28-aefa77d1eff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced6d0d6-1547-4160-b607-54c9b02181e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:49 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Volume 5b7d5872-51f0-4929-b38b-fa8e1908719e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b7d5872-51f0-4929-b38b-fa8e1908719e', 'volume_size': 1}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-599558720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7d5872-51f0-4929-b38b-fa8e1908719e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb47d59977fc4608af9628f848b9a953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:41:49Z,use_quota=True,user_id='558e89b0f77e46288ed0742cf08ba885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Creating volume 5b7d5872-51f0-4929-b38b-fa8e1908719e {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:41:49 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:41:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:49 devstack sudo[82990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e 1073741824
Apr 24 14:41:49 devstack sudo[82990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:50 devstack sudo[82990]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e 1073741824" returned: 0 in 1.112s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:50 devstack sudo[82999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e
Apr 24 14:41:50 devstack sudo[82999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:50 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Acquiring lock "cinder-26a61b08-1547-43fe-bed5-0d6ac75ddea0-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Lock "cinder-26a61b08-1547-43fe-bed5-0d6ac75ddea0-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Acquiring lock "cinder-quobyte-26a61b08-1547-43fe-bed5-0d6ac75ddea0" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Lock "cinder-quobyte-26a61b08-1547-43fe-bed5-0d6ac75ddea0" acquired by "delete_volume" :: waited 0.041s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e25b41a-8ab7-4d94-9466-b827821b55f8]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:51 devstack sudo[82999]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e" returned: 0 in 1.015s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced6d0d6-1547-4160-b607-54c9b02181e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b7d5872-51f0-4929-b38b-fa8e1908719e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4591a2b9-aaff-4468-8759-26dcc0d5d4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:41:51 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Volume volume-5b7d5872-51f0-4929-b38b-fa8e1908719e (5b7d5872-51f0-4929-b38b-fa8e1908719e): created successfully
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4591a2b9-aaff-4468-8759-26dcc0d5d4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:41:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Flow 'volume_create_manager' (bd838efb-6814-4b0c-8422-9dcc47ce5817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:41:51 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c2e1cc37-d3e7-45a4-979e-6db9060843bb tempest-ServersNegativeTestJSON-471486697 None] Created volume successfully.
Apr 24 14:41:51 devstack sudo[83003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0
Apr 24 14:41:51 devstack sudo[83003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:52 devstack sudo[83003]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0" returned: 0 in 0.931s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:52 devstack sudo[83023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0
Apr 24 14:41:52 devstack sudo[83023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:52 devstack sudo[83023]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-26a61b08-1547-43fe-bed5-0d6ac75ddea0" returned: 0 in 0.677s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Lock "cinder-quobyte-26a61b08-1547-43fe-bed5-0d6ac75ddea0" released by "delete_volume" :: held 1.664s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:41:52 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Created reservations ['f7d4af06-0287-43af-89ec-6357cbd8083d', '86cc0eb3-8967-4296-8860-c628e8160302', '374b2062-59d7-4016-bdc0-4d774634e3d1', '1d48779a-7d10-440c-be1e-dbb0dcca411a'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Acquiring lock "cinder-5b7d5872-51f0-4929-b38b-fa8e1908719e-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Lock "cinder-5b7d5872-51f0-4929-b38b-fa8e1908719e-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:53 devstack sudo[83027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:41:53 devstack sudo[83027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Acquiring lock "cinder-quobyte-5b7d5872-51f0-4929-b38b-fa8e1908719e" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Lock "cinder-quobyte-5b7d5872-51f0-4929-b38b-fa8e1908719e" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c680e4d9-eaa8-4fcf-a1bb-e094f9ffd47f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:41:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:53 devstack sudo[83029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e
Apr 24 14:41:53 devstack sudo[83029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:54 devstack sudo[83027]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.233s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:54 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:41:54 devstack sudo[83029]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Deleted volume successfully.
Apr 24 14:41:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e" returned: 0 in 1.172s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c42efa94-f7bd-4bb1-9b70-ca0ca8c06a35 tempest-ServerRescueNegativeTestJSON-1186607925 None] Lock "cinder-26a61b08-1547-43fe-bed5-0d6ac75ddea0-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:41:54 devstack sudo[83048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e
Apr 24 14:41:54 devstack sudo[83048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:55 devstack sudo[83048]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5b7d5872-51f0-4929-b38b-fa8e1908719e" returned: 0 in 1.528s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Lock "cinder-quobyte-5b7d5872-51f0-4929-b38b-fa8e1908719e" released by "delete_volume" :: held 2.751s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Created reservations ['bd8ea05d-ef95-44bf-90f0-61e63c146fa1', '0e159617-9535-483f-9f70-e98d233979e2', 'fe38fa64-5d61-4b37-8c90-f6abb3184c48', 'eb731ae0-4503-4bad-a973-a9293765bc07'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:56 devstack sudo[83117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:41:56 devstack sudo[83117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Acquiring lock "cinder-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Lock "cinder-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Acquiring lock "cinder-quobyte-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Lock "cinder-quobyte-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387" acquired by "delete_volume" :: waited 0.045s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[04738cd7-911d-4149-bc37-df87a5309f56]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:41:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:57 devstack sudo[83120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387
Apr 24 14:41:57 devstack sudo[83120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:57 devstack sudo[83117]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.391s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:57 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:41:57 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Deleted volume successfully.
Apr 24 14:41:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-db3f57c0-08dd-4812-9d2b-bd85857ce57d tempest-ServersNegativeTestJSON-471486697 None] Lock "cinder-5b7d5872-51f0-4929-b38b-fa8e1908719e-delete_volume" released by "delete_volume" :: held 4.675s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:41:58 devstack sudo[83120]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387" returned: 0 in 1.207s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:58 devstack sudo[83127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387
Apr 24 14:41:58 devstack sudo[83127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:41:59 devstack sudo[83127]: pam_unix(sudo:session): session closed for user root
Apr 24 14:41:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387" returned: 0 in 0.914s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:41:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Lock "cinder-quobyte-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387" released by "delete_volume" :: held 2.194s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:41:59 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Created reservations ['12934e3e-9b74-4abd-884f-4d9598ad6087', '5bbe04ff-0c5b-4866-94b5-947e662ea496', 'eb4c38ea-7d42-449d-b2b7-1f0908ebe1c4', '6ef01327-165c-4466-8db7-d9acad360f1c'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:41:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:41:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:41:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:41:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:41:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:41:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:41:59 devstack sudo[83133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:41:59 devstack sudo[83133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:00 devstack sudo[83133]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.952s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:00 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:42:00 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Deleted volume successfully.
Apr 24 14:42:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a783b9bc-0572-4042-8b36-93d1a3bb538f tempest-ServersNegativeTestJSON-471486697 None] Lock "cinder-5ebb766d-0b1e-46fe-81ae-e77f0cfb4387-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:02 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:42:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Flow 'volume_create_manager' (5d41fbae-05af-4aa1-b9f2-52b4fe6c7bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489855e8-fbf6-4363-9e25-c09a5e15228f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489855e8-fbf6-4363-9e25-c09a5e15228f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-784992193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7302673e-9ada-4d7f-b69c-6e8eb1e84736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351b0266724d4b8c997957aeb0e75e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:03Z,use_quota=True,user_id='ac7c0edce05742e283e4283e6a55b15a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfd9c09-ffed-4cae-9920-6dfed6dc5c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfd9c09-ffed-4cae-9920-6dfed6dc5c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdf5e98-4ff8-4512-adc7-d18f0a598a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdf5e98-4ff8-4512-adc7-d18f0a598a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7302673e-9ada-4d7f-b69c-6e8eb1e84736', 'volume_name': 'volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a0db44-f7fa-4e89-8827-efe55d3fbd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a0db44-f7fa-4e89-8827-efe55d3fbd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3432714e-c651-480d-a072-19bef7f55b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:03 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Volume 7302673e-9ada-4d7f-b69c-6e8eb1e84736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736', 'volume_size': 1}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-784992193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7302673e-9ada-4d7f-b69c-6e8eb1e84736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351b0266724d4b8c997957aeb0e75e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:03Z,use_quota=True,user_id='ac7c0edce05742e283e4283e6a55b15a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Creating volume 7302673e-9ada-4d7f-b69c-6e8eb1e84736 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:42:03 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:42:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:03 devstack sudo[83161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736 1073741824
Apr 24 14:42:03 devstack sudo[83161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:04 devstack sudo[83161]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736 1073741824" returned: 0 in 1.089s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:04 devstack sudo[83175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736
Apr 24 14:42:04 devstack sudo[83175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:05 devstack sudo[83175]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736" returned: 0 in 1.031s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] <== create_volume: return (2236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:42:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.246s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3432714e-c651-480d-a072-19bef7f55b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d99fc0-e377-47c7-a92f-5d66c6bf102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:05 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Volume volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736 (7302673e-9ada-4d7f-b69c-6e8eb1e84736): created successfully
Apr 24 14:42:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d99fc0-e377-47c7-a92f-5d66c6bf102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Flow 'volume_create_manager' (5d41fbae-05af-4aa1-b9f2-52b4fe6c7bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:05 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b85ff51e-ab57-45a2-8d5a-1e5004c48bf5 tempest-DeleteServersTestJSON-224950650 None] Created volume successfully.
Apr 24 14:42:12 devstack cinder-volume[81510]: WARNING py.warnings [req-58db6ec0-469c-4542-ae77-f8920e78be42 req-4c1cb234-cd65-4f09-a4a4-71a87965e904 tempest-DeleteServersTestJSON-224950650 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Apr 24 14:42:12 devstack cinder-volume[81510]:   .first()
Apr 24 14:42:12 devstack cinder-volume[81510]: 
Apr 24 14:42:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-58db6ec0-469c-4542-ae77-f8920e78be42 req-4c1cb234-cd65-4f09-a4a4-71a87965e904 tempest-DeleteServersTestJSON-224950650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-58db6ec0-469c-4542-ae77-f8920e78be42 req-4c1cb234-cd65-4f09-a4a4-71a87965e904 tempest-DeleteServersTestJSON-224950650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:12 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e171ef-d75d-4b85-a0b1-884b4b7c9cc6]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-58db6ec0-469c-4542-ae77-f8920e78be42 req-4c1cb234-cd65-4f09-a4a4-71a87965e904 tempest-DeleteServersTestJSON-224950650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:12 devstack sudo[83229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736
Apr 24 14:42:12 devstack sudo[83229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:13 devstack sudo[83229]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-58db6ec0-469c-4542-ae77-f8920e78be42 req-4c1cb234-cd65-4f09-a4a4-71a87965e904 tempest-DeleteServersTestJSON-224950650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736" returned: 0 in 0.649s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-58db6ec0-469c-4542-ae77-f8920e78be42 req-4c1cb234-cd65-4f09-a4a4-71a87965e904 tempest-DeleteServersTestJSON-224950650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.671s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-58db6ec0-469c-4542-ae77-f8920e78be42 req-4c1cb234-cd65-4f09-a4a4-71a87965e904 tempest-DeleteServersTestJSON-224950650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d', 'name': 'volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce0b9a0a-dc2a-4f22-bb74-675827e86cdc', 'enforce_multipath': True} {{(pid=81510) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 24 14:42:13 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-58db6ec0-469c-4542-ae77-f8920e78be42 req-4c1cb234-cd65-4f09-a4a4-71a87965e904 tempest-DeleteServersTestJSON-224950650 None] attachment_update completed successfully.
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Flow 'volume_create_manager' (7f2c2f34-6fc0-47e6-9336-86cde7cc2af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66977403-f082-4eca-adea-432191edb287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66977403-f082-4eca-adea-432191edb287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1478256857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f58f9b7-34bf-43fe-8e17-6e7866b07d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b2fb4f6a27426989e6f9b10f078296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:21Z,use_quota=True,user_id='d847be82a7f24022b3ef2fce2b0d3554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aab0faf-8c51-4630-8a70-def32b602d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aab0faf-8c51-4630-8a70-def32b602d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74e01f1-696a-42ab-bb46-46056bf031a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74e01f1-696a-42ab-bb46-46056bf031a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f58f9b7-34bf-43fe-8e17-6e7866b07d2b', 'volume_name': 'volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddde9a1a-0976-4be9-89eb-ec9cbfeeecc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddde9a1a-0976-4be9-89eb-ec9cbfeeecc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8621890d-7f2d-4bf2-9113-cbaeec3a1aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:21 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Volume 8f58f9b7-34bf-43fe-8e17-6e7866b07d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b', 'volume_size': 1}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1478256857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f58f9b7-34bf-43fe-8e17-6e7866b07d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b2fb4f6a27426989e6f9b10f078296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:21Z,use_quota=True,user_id='d847be82a7f24022b3ef2fce2b0d3554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Creating volume 8f58f9b7-34bf-43fe-8e17-6e7866b07d2b {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:42:21 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:42:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:21 devstack sudo[83688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b 1073741824
Apr 24 14:42:21 devstack sudo[83688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:22 devstack sudo[83688]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b 1073741824" returned: 0 in 0.993s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:22 devstack sudo[83720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b
Apr 24 14:42:22 devstack sudo[83720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:23 devstack sudo[83720]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b" returned: 0 in 0.652s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:42:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8621890d-7f2d-4bf2-9113-cbaeec3a1aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a772930-afa9-44d8-8269-c678b6ad3c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:23 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Volume volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b (8f58f9b7-34bf-43fe-8e17-6e7866b07d2b): created successfully
Apr 24 14:42:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a772930-afa9-44d8-8269-c678b6ad3c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Flow 'volume_create_manager' (7f2c2f34-6fc0-47e6-9336-86cde7cc2af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:23 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-6159fb1c-d649-4fda-b2de-deffbf82ff44 req-4a9745f9-b19f-4d9d-8b99-f675fbc85e72 tempest-VolumesSnapshotsTestJSON-656463678 None] Created volume successfully.
Apr 24 14:42:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-dd3a8eb3-80a5-46bb-bca2-4a1e79794676 tempest-BackendsCapabilitiesAdminTestsJSON-873011383 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6256141662598, 'free_capacity_gb': 1775.6256141662598, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81510) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 24 14:42:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb2fb380-e15e-4637-b65d-2ff64345710b tempest-BackendsCapabilitiesAdminTestsJSON-873011383 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6256141662598, 'free_capacity_gb': 1775.6256141662598, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81510) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 24 14:42:24 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-1fc3652e-06f0-4bdf-afc0-1c3f646ac706 req-e9b539ab-25bf-43d1-a164-6465addebf6f tempest-DeleteServersTestJSON-224950650 None] Terminate volume connection completed successfully.
Apr 24 14:42:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-1fc3652e-06f0-4bdf-afc0-1c3f646ac706 req-e9b539ab-25bf-43d1-a164-6465addebf6f tempest-DeleteServersTestJSON-224950650 None] Deleting attachment ce0b9a0a-dc2a-4f22-bb74-675827e86cdc. {{(pid=81510) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 24 14:42:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] Creating offline snapshot 8b618136-2eab-4a78-b2d6-6dcee34eadc6 of volume 8f58f9b7-34bf-43fe-8e17-6e7866b07d2b {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:42:24 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1d56ad-cb9b-4044-8703-f4835543cb44]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:24 devstack sudo[83725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b
Apr 24 14:42:24 devstack sudo[83725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:25 devstack sudo[83725]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b" returned: 0 in 0.739s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:25 devstack sudo[83730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6 1G
Apr 24 14:42:25 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:26 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6 1G" returned: 0 in 0.879s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:26 devstack sudo[83735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6
Apr 24 14:42:26 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:26 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6" returned: 0 in 0.659s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:26 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6 is being set with open permissions: ugo+rw
Apr 24 14:42:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:26 devstack sudo[83743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6
Apr 24 14:42:26 devstack sudo[83743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:27 devstack sudo[83743]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6" returned: 0 in 0.577s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:27 devstack sudo[83746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.info
Apr 24 14:42:27 devstack sudo[83746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:27 devstack sudo[83746]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.info" returned: 0 in 0.608s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:27 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.info is being set with open permissions: ugo+rw
Apr 24 14:42:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:27 devstack sudo[83749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.info
Apr 24 14:42:27 devstack sudo[83749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:27 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Acquiring lock "cinder-7302673e-9ada-4d7f-b69c-6e8eb1e84736-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Lock "cinder-7302673e-9ada-4d7f-b69c-6e8eb1e84736-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Acquiring lock "cinder-quobyte-7302673e-9ada-4d7f-b69c-6e8eb1e84736" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Lock "cinder-quobyte-7302673e-9ada-4d7f-b69c-6e8eb1e84736" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:28 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f7bc40-9cd6-40a6-b272-ef74b7b5fefc]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:28 devstack sudo[83751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736
Apr 24 14:42:28 devstack sudo[83751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:28 devstack sudo[83749]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.info" returned: 0 in 0.539s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.149s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:28 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-ab25035c-8e24-4e7c-9498-020e732320fe req-33ea4425-00aa-4bc7-99e3-3b438616cc11 tempest-VolumesSnapshotsTestJSON-656463678 None] Create snapshot completed successfully
Apr 24 14:42:28 devstack sudo[83751]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736" returned: 0 in 0.675s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:28 devstack sudo[83757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736
Apr 24 14:42:28 devstack sudo[83757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Acquiring lock "cinder-8b618136-2eab-4a78-b2d6-6dcee34eadc6-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "cinder-8b618136-2eab-4a78-b2d6-6dcee34eadc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Acquiring lock "cinder-quobyte-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "cinder-quobyte-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Acquiring lock "cinder-quobyte-8b618136-2eab-4a78-b2d6-6dcee34eadc6" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "cinder-quobyte-8b618136-2eab-4a78-b2d6-6dcee34eadc6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Deleting offline snapshot 8b618136-2eab-4a78-b2d6-6dcee34eadc6 of volume 8f58f9b7-34bf-43fe-8e17-6e7866b07d2b {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] snapshot_file for this snap is: volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7f9147-c847-4164-ac3e-4e201d7ddab2]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:29 devstack sudo[83759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6
Apr 24 14:42:29 devstack sudo[83759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:29 devstack sudo[83757]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7302673e-9ada-4d7f-b69c-6e8eb1e84736" returned: 0 in 0.595s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Lock "cinder-quobyte-7302673e-9ada-4d7f-b69c-6e8eb1e84736" released by "delete_volume" :: held 1.332s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Created reservations ['dc9b75cb-f5f1-4090-b3e2-ee00a5c434c3', 'c0017882-c4d5-44af-a4ca-cbd38f63d4ff', 'be5453ec-9807-40e7-b6ce-be0b18fab534', 'b76f4798-6133-4033-aab2-fef03a0e736e'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:29 devstack sudo[83762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:42:29 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:29 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-abd2ca5f-d329-4887-bb00-8dc00bb8dad5 tempest-GroupSnapshotsV319Test-504844619 None] Group tempest-GroupSnapshotsV319Test-Group-653538249: creating
Apr 24 14:42:29 devstack sudo[83759]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6" returned: 0 in 0.652s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb368d9d-0832-403a-84b3-20d60c728393]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:29 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-abd2ca5f-d329-4887-bb00-8dc00bb8dad5 tempest-GroupSnapshotsV319Test-504844619 None] Group tempest-GroupSnapshotsV319Test-Group-653538249: created successfully
Apr 24 14:42:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:29 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-abd2ca5f-d329-4887-bb00-8dc00bb8dad5 tempest-GroupSnapshotsV319Test-504844619 None] Create group completed successfully.
Apr 24 14:42:29 devstack sudo[83767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b
Apr 24 14:42:29 devstack sudo[83767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:30 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.532s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:30 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:42:30 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Deleted volume successfully.
Apr 24 14:42:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-156c0b20-82f2-454f-89a3-2fb9f7076910 tempest-DeleteServersTestJSON-224950650 None] Lock "cinder-7302673e-9ada-4d7f-b69c-6e8eb1e84736-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:30 devstack sudo[83767]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b" returned: 0 in 0.557s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:30 devstack sudo[83773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6
Apr 24 14:42:30 devstack sudo[83773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:31 devstack sudo[83773]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6" returned: 0 in 0.707s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:31 devstack sudo[83778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6
Apr 24 14:42:31 devstack sudo[83778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Flow 'volume_create_manager' (fb5791e2-732d-4a39-a4a4-d3b9f4b186dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3a33fe-7a7a-4cb5-ae97-bd8638309ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3a33fe-7a7a-4cb5-ae97-bd8638309ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-856934784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=645dfcda-00fb-4369-a51c-d22ec585a2f6,host='devstack@QuobyteHD#QuobyteHD',id=f6ad5935-06b3-4ef3-8011-9f11785b2900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c67108f6b24346a8e7ce497c1a420d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:31Z,use_quota=True,user_id='59d9b7dff83742658fd6f5be2f36b691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f85d4177-cdc3-42e9-9261-2e0919a4bbda),volume_type_id=f85d4177-cdc3-42e9-9261-2e0919a4bbda)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51803316-fd8e-4f38-b2aa-72a86dfddc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51803316-fd8e-4f38-b2aa-72a86dfddc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8831565-3d2e-42d0-843f-b6a0789d163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8831565-3d2e-42d0-843f-b6a0789d163a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ad5935-06b3-4ef3-8011-9f11785b2900', 'volume_name': 'volume-f6ad5935-06b3-4ef3-8011-9f11785b2900', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f6ada4-5610-422f-bea0-544a09adc191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f6ada4-5610-422f-bea0-544a09adc191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fc2453-2dcb-4fe9-a712-3e0150933654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:31 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Volume f6ad5935-06b3-4ef3-8011-9f11785b2900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ad5935-06b3-4ef3-8011-9f11785b2900', 'volume_size': 1}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=645dfcda-00fb-4369-a51c-d22ec585a2f6,created_at=2026-04-24T12:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-856934784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=645dfcda-00fb-4369-a51c-d22ec585a2f6,host='devstack@QuobyteHD#QuobyteHD',id=f6ad5935-06b3-4ef3-8011-9f11785b2900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c67108f6b24346a8e7ce497c1a420d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:31Z,use_quota=True,user_id='59d9b7dff83742658fd6f5be2f36b691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f85d4177-cdc3-42e9-9261-2e0919a4bbda),volume_type_id=f85d4177-cdc3-42e9-9261-2e0919a4bbda)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Creating volume f6ad5935-06b3-4ef3-8011-9f11785b2900 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:42:31 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:31 devstack sudo[83780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 1073741824
Apr 24 14:42:31 devstack sudo[83780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:31 devstack sudo[83778]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b.8b618136-2eab-4a78-b2d6-6dcee34eadc6" returned: 0 in 0.684s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "cinder-quobyte-8b618136-2eab-4a78-b2d6-6dcee34eadc6" released by "_delete_snapshot" :: held 2.735s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "cinder-quobyte-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b" released by "delete_snapshot" :: held 2.760s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:31 devstack cinder-volume[81510]: WARNING cinder.quota [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:42:31 devstack cinder-volume[81510]: DEBUG cinder.quota [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Created reservations ['5cd700a2-497d-47f4-a61b-042514d5008e', '84e9e8e1-6b94-46a7-a86e-06d144a99b26', '7ada01d2-5319-4ce6-83ac-e3788080d6a2', '93501ef9-6527-46d4-aaa8-5be0a57c4662'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:42:31 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Delete snapshot completed successfully.
Apr 24 14:42:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-02d74a6e-9b30-4c6b-b758-e395e0879c15 req-37057f9f-2f63-4e4b-ad4d-9db86d89fa55 tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "cinder-8b618136-2eab-4a78-b2d6-6dcee34eadc6-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:32 devstack sudo[83780]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 1073741824" returned: 0 in 0.903s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:32 devstack sudo[83788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900
Apr 24 14:42:32 devstack sudo[83788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Acquiring lock "cinder-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "cinder-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Acquiring lock "cinder-quobyte-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "cinder-quobyte-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:32 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e29daf7-8f1b-4d98-b400-d31a8e9b0092]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:32 devstack sudo[83790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b
Apr 24 14:42:32 devstack sudo[83790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:33 devstack sudo[83788]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900" returned: 0 in 0.701s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:33 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:42:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fc2453-2dcb-4fe9-a712-3e0150933654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ad5935-06b3-4ef3-8011-9f11785b2900', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4cbe0b-86cb-4d60-9473-b66b1e987fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:33 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Volume volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 (f6ad5935-06b3-4ef3-8011-9f11785b2900): created successfully
Apr 24 14:42:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4cbe0b-86cb-4d60-9473-b66b1e987fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Flow 'volume_create_manager' (fb5791e2-732d-4a39-a4a4-d3b9f4b186dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:33 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-90a93cd8-3e63-4e7c-bff3-fb1e07bc70a0 tempest-GroupSnapshotsV319Test-504844619 None] Created volume successfully.
Apr 24 14:42:33 devstack sudo[83790]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b" returned: 0 in 0.775s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:33 devstack sudo[83802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b
Apr 24 14:42:33 devstack sudo[83802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:33 devstack sudo[83802]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b" returned: 0 in 0.630s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "cinder-quobyte-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b" released by "delete_volume" :: held 1.500s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:34 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] GroupSnapshot 1a9bc365-7115-42d8-8f9a-3653527f15a8: creating.
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] Group snapshot 1a9bc365-7115-42d8-8f9a-3653527f15a8: creating. {{(pid=81510) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] Creating offline snapshot 8dee4bba-bf28-4498-8e2b-7dc371110136 of volume f6ad5935-06b3-4ef3-8011-9f11785b2900 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG cinder.quota [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Created reservations ['365ede41-da46-41f4-b74a-a59ba4e56e4b', '63b811e0-5b1a-4991-b959-f117f66b7786', '5b1c01b4-dd26-4555-8173-63164546693a', '9aa46cbb-6168-4dc6-8d1e-4883495e1a93'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf47b61-118b-4617-9e4e-ef8df52e4e13]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:34 devstack sudo[83815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900
Apr 24 14:42:34 devstack sudo[83815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:34 devstack sudo[83817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:42:34 devstack sudo[83817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:34 devstack sudo[83815]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900" returned: 0 in 0.673s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:34 devstack sudo[83823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136 1G
Apr 24 14:42:34 devstack sudo[83823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:35 devstack sudo[83817]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.796s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:35 devstack cinder-volume[81510]: DEBUG cinder.manager [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:42:35 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Deleted volume successfully.
Apr 24 14:42:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-38c78da2-5aad-4b42-ac24-29edd5f0547c req-555273bd-bd47-4de0-a64c-541fc808304c tempest-VolumesSnapshotsTestJSON-656463678 None] Lock "cinder-8f58f9b7-34bf-43fe-8e17-6e7866b07d2b-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:35 devstack sudo[83823]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136 1G" returned: 0 in 0.695s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:35 devstack sudo[83833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136
Apr 24 14:42:35 devstack sudo[83833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:36 devstack sudo[83833]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136" returned: 0 in 0.710s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:36 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:42:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:36 devstack sudo[83838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136
Apr 24 14:42:36 devstack sudo[83838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:36 devstack sudo[83838]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136" returned: 0 in 0.579s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:36 devstack sudo[83841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.info
Apr 24 14:42:36 devstack sudo[83841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:37 devstack sudo[83841]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.info" returned: 0 in 0.582s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:37 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:42:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:37 devstack sudo[83848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.info
Apr 24 14:42:37 devstack sudo[83848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:38 devstack sudo[83848]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.info" returned: 0 in 0.608s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.979s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Flow 'volume_create_manager' (09ef72bb-7017-4447-b32c-891c61c24fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db5213e-b750-4147-91d2-96e8ff00fb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db5213e-b750-4147-91d2-96e8ff00fb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-470823864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c07a180-2c1b-4f5b-beae-dc17c7a118c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19d13249fdc04fac96c68bf03d630c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:38Z,use_quota=True,user_id='6a1582fb3c9a4778802d11af3b5a16b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90bec7d-ee61-45fc-a276-dd04930cb4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90bec7d-ee61-45fc-a276-dd04930cb4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a47072f-4a4f-47bd-824f-3c4daef6e9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a47072f-4a4f-47bd-824f-3c4daef6e9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c07a180-2c1b-4f5b-beae-dc17c7a118c2', 'volume_name': 'volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45d097b-37c9-4808-9cc3-4d763fe48591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45d097b-37c9-4808-9cc3-4d763fe48591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a1d103-f0f7-43c7-871c-a834f69017e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:38 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Volume 4c07a180-2c1b-4f5b-beae-dc17c7a118c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2', 'volume_size': 1}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-470823864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c07a180-2c1b-4f5b-beae-dc17c7a118c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='19d13249fdc04fac96c68bf03d630c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:38Z,use_quota=True,user_id='6a1582fb3c9a4778802d11af3b5a16b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Creating volume 4c07a180-2c1b-4f5b-beae-dc17c7a118c2 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:42:38 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:42:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:38 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-44a16303-6962-4d9c-9315-8c62c5f62079 tempest-GroupSnapshotsV319Test-504844619 None] group_snapshot 1a9bc365-7115-42d8-8f9a-3653527f15a8: created successfully
Apr 24 14:42:38 devstack sudo[83877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2 1073741824
Apr 24 14:42:38 devstack sudo[83877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:39 devstack sudo[83877]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2 1073741824" returned: 0 in 0.972s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:39 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=63,cinder:UPDATE=73,cinder:INSERT=12,cinder:DELETE=5 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:42:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:39 devstack sudo[83898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2
Apr 24 14:42:39 devstack sudo[83898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:39 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-85132cd2-cf1d-4c07-a0ec-0f896c424876 tempest-GroupSnapshotsTest-1418024490 None] Group tempest-GroupSnapshotsTest-Group-1010273570: creating
Apr 24 14:42:40 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-85132cd2-cf1d-4c07-a0ec-0f896c424876 tempest-GroupSnapshotsTest-1418024490 None] Group tempest-GroupSnapshotsTest-Group-1010273570: created successfully
Apr 24 14:42:40 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] group_snapshot 1a9bc365-7115-42d8-8f9a-3653527f15a8: deleting
Apr 24 14:42:40 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-85132cd2-cf1d-4c07-a0ec-0f896c424876 tempest-GroupSnapshotsTest-1418024490 None] Create group completed successfully.
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] group_snapshot 1a9bc365-7115-42d8-8f9a-3653527f15a8: deleting {{(pid=81510) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Acquiring lock "cinder-quobyte-f6ad5935-06b3-4ef3-8011-9f11785b2900" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Lock "cinder-quobyte-f6ad5935-06b3-4ef3-8011-9f11785b2900" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Acquiring lock "cinder-quobyte-8dee4bba-bf28-4498-8e2b-7dc371110136" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Lock "cinder-quobyte-8dee4bba-bf28-4498-8e2b-7dc371110136" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Deleting offline snapshot 8dee4bba-bf28-4498-8e2b-7dc371110136 of volume f6ad5935-06b3-4ef3-8011-9f11785b2900 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] snapshot_file for this snap is: volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7d55f0-11ab-45c6-addf-b7d2671f45ca]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:40 devstack sudo[83900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136
Apr 24 14:42:40 devstack sudo[83900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:40 devstack sudo[83898]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2" returned: 0 in 0.909s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a1d103-f0f7-43c7-871c-a834f69017e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90688c3-aacc-4131-9ed4-9fa6228a812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:40 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Volume volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2 (4c07a180-2c1b-4f5b-beae-dc17c7a118c2): created successfully
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90688c3-aacc-4131-9ed4-9fa6228a812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Flow 'volume_create_manager' (09ef72bb-7017-4447-b32c-891c61c24fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:UPDATE=66,cinder:SELECT=60,cinder:INSERT=20,cinder:DELETE=6 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:42:40 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-749ed3cf-849e-48fb-9a7a-6c5d186a3f49 req-e14125e6-25d5-405f-a019-2adf8552f091 tempest-VolumesGetTestJSON-1504009297 None] Created volume successfully.
Apr 24 14:42:40 devstack sudo[83900]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136" returned: 0 in 0.748s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6ad5935-06b3-4ef3-8011-9f11785b2900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d59b8d-3b66-46b5-adf8-a94cabeeb607]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:41 devstack sudo[83907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900
Apr 24 14:42:41 devstack sudo[83907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Flow 'volume_create_manager' (77c4f72b-f85f-4f26-ac8c-dcc4eac8b1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1b4e1b-42ca-4dfd-a03d-565f93ac674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1b4e1b-42ca-4dfd-a03d-565f93ac674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943696380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=31055fb8-bd38-48e0-adc9-e830a3aefc67,host='devstack@QuobyteHD#QuobyteHD',id=8c217888-6296-4660-807f-4aef6338d3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5aa2fdd11f4f7ab69c44100a421679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:42Z,use_quota=True,user_id='45353ef254a847589f363f133403f9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7562b0b5-cdc1-41bb-af9b-fbc627eee7a0),volume_type_id=7562b0b5-cdc1-41bb-af9b-fbc627eee7a0)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dab9d67-21c9-49e2-b7be-d87bc6e2d61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dab9d67-21c9-49e2-b7be-d87bc6e2d61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04df621b-3fd3-4dba-b6e0-60acd06ae056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04df621b-3fd3-4dba-b6e0-60acd06ae056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c217888-6296-4660-807f-4aef6338d3fa', 'volume_name': 'volume-8c217888-6296-4660-807f-4aef6338d3fa', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf6f6e4-e3f5-4d66-a5ab-a89e65b2ccdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf6f6e4-e3f5-4d66-a5ab-a89e65b2ccdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b740f44d-27b6-4913-9985-b4f2897ab4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:41 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Volume 8c217888-6296-4660-807f-4aef6338d3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c217888-6296-4660-807f-4aef6338d3fa', 'volume_size': 1}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=31055fb8-bd38-48e0-adc9-e830a3aefc67,created_at=2026-04-24T12:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943696380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=31055fb8-bd38-48e0-adc9-e830a3aefc67,host='devstack@QuobyteHD#QuobyteHD',id=8c217888-6296-4660-807f-4aef6338d3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5aa2fdd11f4f7ab69c44100a421679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:42Z,use_quota=True,user_id='45353ef254a847589f363f133403f9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7562b0b5-cdc1-41bb-af9b-fbc627eee7a0),volume_type_id=7562b0b5-cdc1-41bb-af9b-fbc627eee7a0)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Creating volume 8c217888-6296-4660-807f-4aef6338d3fa {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:42:41 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:41 devstack sudo[83912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa 1073741824
Apr 24 14:42:41 devstack sudo[83912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:41 devstack sudo[83907]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900" returned: 0 in 0.848s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:41 devstack sudo[83914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136
Apr 24 14:42:41 devstack sudo[83914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Acquiring lock "cinder-4c07a180-2c1b-4f5b-beae-dc17c7a118c2-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Lock "cinder-4c07a180-2c1b-4f5b-beae-dc17c7a118c2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Acquiring lock "cinder-quobyte-4c07a180-2c1b-4f5b-beae-dc17c7a118c2" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Lock "cinder-quobyte-4c07a180-2c1b-4f5b-beae-dc17c7a118c2" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:42 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f42b5b-4d0d-4fbf-8f1d-09a5d02e0d21]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:42 devstack sudo[83920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2
Apr 24 14:42:42 devstack sudo[83920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:42 devstack sudo[83912]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa 1073741824" returned: 0 in 0.898s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:42 devstack sudo[83925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa
Apr 24 14:42:42 devstack sudo[83925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:42 devstack sudo[83914]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136" returned: 0 in 1.038s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:42 devstack sudo[83928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136
Apr 24 14:42:42 devstack sudo[83928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:43 devstack sudo[83925]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa" returned: 0 in 0.643s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:43 devstack sudo[83934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:42:43 devstack sudo[83934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b740f44d-27b6-4913-9985-b4f2897ab4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c217888-6296-4660-807f-4aef6338d3fa', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a46899-1eb4-436e-9936-e57a33875f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:43 devstack sudo[83920]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2" returned: 0 in 0.937s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:43 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Volume volume-8c217888-6296-4660-807f-4aef6338d3fa (8c217888-6296-4660-807f-4aef6338d3fa): created successfully
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a46899-1eb4-436e-9936-e57a33875f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Flow 'volume_create_manager' (77c4f72b-f85f-4f26-ac8c-dcc4eac8b1a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-da87ea06-e634-4efd-b304-0cfea0b05050 tempest-GroupSnapshotsTest-1418024490 None] Created volume successfully.
Apr 24 14:42:43 devstack sudo[83937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2
Apr 24 14:42:43 devstack sudo[83937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:43 devstack sudo[83928]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900.8dee4bba-bf28-4498-8e2b-7dc371110136" returned: 0 in 0.673s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Lock "cinder-quobyte-8dee4bba-bf28-4498-8e2b-7dc371110136" released by "_delete_snapshot" :: held 3.466s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Lock "cinder-quobyte-f6ad5935-06b3-4ef3-8011-9f11785b2900" released by "delete_snapshot" :: held 3.495s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:43 devstack cinder-volume[81510]: WARNING cinder.quota [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-508293905 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-508293905, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:42:43 devstack cinder-volume[81510]: WARNING cinder.quota [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-508293905 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-508293905, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:42:43 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] Created reservations ['af7ad0db-9cd9-497a-b7a1-0ee4d6da7de9', '3e2fa986-efe1-42a6-ab40-c596980ef195', 'd44c9ec0-f6fe-4a23-b3a5-f54f3581240b', 'feb896a1-9ee7-4d23-82d6-b4c15dd77c85'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:42:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-53678746-a860-4587-b1e9-fac3f20009b7 tempest-GroupSnapshotsV319Test-504844619 None] group_snapshot 1a9bc365-7115-42d8-8f9a-3653527f15a8: deleted successfully
Apr 24 14:42:44 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] GroupSnapshot 18bce2ed-9296-4071-8b2c-4375366dd10a: creating.
Apr 24 14:42:44 devstack sudo[83934]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.849s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] Group snapshot 18bce2ed-9296-4071-8b2c-4375366dd10a: creating. {{(pid=81510) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 14:42:44 devstack sudo[83937]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4c07a180-2c1b-4f5b-beae-dc17c7a118c2" returned: 0 in 0.803s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] Creating offline snapshot 0d232214-aff9-4e0c-b84f-504cae3a7d46 of volume 8c217888-6296-4660-807f-4aef6338d3fa {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Lock "cinder-quobyte-4c07a180-2c1b-4f5b-beae-dc17c7a118c2" released by "delete_volume" :: held 1.803s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8550cf4a-5aff-4a8e-9fae-b4b0225ca340]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG cinder.quota [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Created reservations ['50532a68-b92a-46c5-98b6-623edc502c82', 'abbf0d82-c59e-42e0-a63d-a9bb045264cd', '01f11f56-9d89-4619-824b-224d7038060d', '1c0f03ce-85b8-421c-9e57-359ebf564c32'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:42:44 devstack sudo[83941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa
Apr 24 14:42:44 devstack sudo[83941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:44 devstack sudo[83943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:42:44 devstack sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:45 devstack sudo[83943]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.712s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:45 devstack cinder-volume[81510]: DEBUG cinder.manager [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:42:45 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Deleted volume successfully.
Apr 24 14:42:45 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Acquiring lock "cinder-quobyte-f6ad5935-06b3-4ef3-8011-9f11785b2900" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:45 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-8689f6e3-48da-4e59-8982-36cf7f75ed71 req-3bbb1e05-01f7-4b99-a0b9-1aa61ddb5fa7 tempest-VolumesGetTestJSON-1504009297 None] Lock "cinder-4c07a180-2c1b-4f5b-beae-dc17c7a118c2-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:45 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Lock "cinder-quobyte-f6ad5935-06b3-4ef3-8011-9f11785b2900" acquired by "delete_volume" :: waited 0.055s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:45 devstack sudo[83941]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa" returned: 0 in 1.078s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:45 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b6c364-4ed6-46aa-b2af-247e5094d8bf]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:45 devstack sudo[83949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46 1G
Apr 24 14:42:45 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:45 devstack sudo[83950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900
Apr 24 14:42:45 devstack sudo[83950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:46 devstack sudo[83950]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900" returned: 0 in 0.795s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:46 devstack sudo[83960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900
Apr 24 14:42:46 devstack sudo[83960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:46 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46 1G" returned: 0 in 1.036s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c217888-6296-4660-807f-4aef6338d3fa -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:46 devstack sudo[83966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c217888-6296-4660-807f-4aef6338d3fa -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46
Apr 24 14:42:46 devstack sudo[83966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:46 devstack sudo[83960]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ad5935-06b3-4ef3-8011-9f11785b2900" returned: 0 in 0.713s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Lock "cinder-quobyte-f6ad5935-06b3-4ef3-8011-9f11785b2900" released by "delete_volume" :: held 1.615s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:42:47 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Created reservations ['297156da-2b1d-426f-a01e-e83a05edff14'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:42:47 devstack cinder-volume[81510]: WARNING cinder.quota [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-508293905 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-508293905, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:42:47 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Created reservations ['80658ad8-53d8-458b-9677-80b584dc599c', 'ddaf2dc3-39f4-4030-991d-65f7ef9c96c6', '5065f071-95ab-48e2-91c2-593816232d26', '66b9c781-a894-4c5f-b5ce-4ba4bb41cfc5'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:42:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:47 devstack sudo[83987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:42:47 devstack sudo[83987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:47 devstack sudo[83966]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c217888-6296-4660-807f-4aef6338d3fa -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46" returned: 0 in 0.951s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:47 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:42:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:47 devstack sudo[83992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46
Apr 24 14:42:47 devstack sudo[83992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:48 devstack sudo[83987]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.019s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:48 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:42:48 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-559e2010-aa3c-4d72-be0c-014b2719a7ba tempest-GroupSnapshotsV319Test-504844619 None] Delete group completed successfully.
Apr 24 14:42:48 devstack sudo[83992]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46" returned: 0 in 0.965s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:48 devstack sudo[84012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.info
Apr 24 14:42:48 devstack sudo[84012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:49 devstack sudo[84012]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.info" returned: 0 in 1.061s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:49 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:42:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:49 devstack sudo[84016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.info
Apr 24 14:42:49 devstack sudo[84016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Flow 'volume_create_manager' (817caf3c-b41e-45f8-881f-7dadddcce42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1015b9-26da-43c1-b3c9-2ddd0667089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1015b9-26da-43c1-b3c9-2ddd0667089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1642788062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271fb563-fe62-463d-b7c4-afdeaa43e73e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a15130fd7f94bf28ff400de0e5b78cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:50Z,use_quota=True,user_id='55d67a15e4424485a170eec9f666b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a821e9c-5315-4315-869a-02e52338c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a821e9c-5315-4315-869a-02e52338c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38d7701-ef35-43ba-8ef5-5b2a49c1abfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38d7701-ef35-43ba-8ef5-5b2a49c1abfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271fb563-fe62-463d-b7c4-afdeaa43e73e', 'volume_name': 'volume-271fb563-fe62-463d-b7c4-afdeaa43e73e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63a8116-551b-4867-9fce-329aa64ce714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63a8116-551b-4867-9fce-329aa64ce714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490e19ad-eb93-4aac-aeba-05dee4129eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:50 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Volume 271fb563-fe62-463d-b7c4-afdeaa43e73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271fb563-fe62-463d-b7c4-afdeaa43e73e', 'volume_size': 1}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:50 devstack sudo[84016]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.info" returned: 0 in 1.060s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.276s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.222s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1642788062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271fb563-fe62-463d-b7c4-afdeaa43e73e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a15130fd7f94bf28ff400de0e5b78cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:50Z,use_quota=True,user_id='55d67a15e4424485a170eec9f666b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Creating volume 271fb563-fe62-463d-b7c4-afdeaa43e73e {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:42:50 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:42:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:50 devstack sudo[84021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e 1073741824
Apr 24 14:42:50 devstack sudo[84021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:50 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ecaf83eb-d644-40d9-8ca7-ccd8a108454a tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 18bce2ed-9296-4071-8b2c-4375366dd10a: created successfully
Apr 24 14:42:51 devstack sudo[84021]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e 1073741824" returned: 0 in 1.184s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:51 devstack sudo[84058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e
Apr 24 14:42:51 devstack sudo[84058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:52 devstack sudo[84058]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e" returned: 0 in 0.901s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:42:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490e19ad-eb93-4aac-aeba-05dee4129eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271fb563-fe62-463d-b7c4-afdeaa43e73e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a75e8f9-e091-4eb3-a26b-9b2d845550f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:52 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Volume volume-271fb563-fe62-463d-b7c4-afdeaa43e73e (271fb563-fe62-463d-b7c4-afdeaa43e73e): created successfully
Apr 24 14:42:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a75e8f9-e091-4eb3-a26b-9b2d845550f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Flow 'volume_create_manager' (817caf3c-b41e-45f8-881f-7dadddcce42e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:52 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4ed92b98-5217-46b4-8176-0cfb1f6af0b3 tempest-VolumesTestJSON-91512523 None] Created volume successfully.
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-0d232214-aff9-4e0c-b84f-504cae3a7d46-656cc50f-26da-4a7f-86f9-3533966332ca" by "_create_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-0d232214-aff9-4e0c-b84f-504cae3a7d46-656cc50f-26da-4a7f-86f9-3533966332ca" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Creating volume 656cc50f-26da-4a7f-86f9-3533966332ca from snapshot 0d232214-aff9-4e0c-b84f-504cae3a7d46 {{(pid=81510) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-656cc50f-26da-4a7f-86f9-3533966332ca" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-656cc50f-26da-4a7f-86f9-3533966332ca" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] snapshot: 0d232214-aff9-4e0c-b84f-504cae3a7d46, volume: 656cc50f-26da-4a7f-86f9-3533966332ca,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a938a3-2a14-4aa2-8278-5928c8f9628e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:53 devstack sudo[84063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46
Apr 24 14:42:53 devstack sudo[84063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Flow 'volume_create_manager' (b947fffe-7207-4eac-8fc0-70f593b6292a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70372040-5f31-46c2-a2b0-9f15c63b8b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70372040-5f31-46c2-a2b0-9f15c63b8b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-581728754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4463a39-ded8-47ce-8e55-941541b95e73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a15130fd7f94bf28ff400de0e5b78cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:54Z,use_quota=True,user_id='55d67a15e4424485a170eec9f666b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4101026-296d-40f2-b4ee-127c81d81248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4101026-296d-40f2-b4ee-127c81d81248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74472a8-a63c-4898-ae3a-88fed1594b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74472a8-a63c-4898-ae3a-88fed1594b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4463a39-ded8-47ce-8e55-941541b95e73', 'volume_name': 'volume-d4463a39-ded8-47ce-8e55-941541b95e73', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfde74b-236a-47b3-8f95-89c84dfbe5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfde74b-236a-47b3-8f95-89c84dfbe5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a48cde6-5d83-407e-add4-bfaa799d19cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:54 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Volume d4463a39-ded8-47ce-8e55-941541b95e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4463a39-ded8-47ce-8e55-941541b95e73', 'volume_size': 1}
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:42:54 devstack sudo[84063]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46" returned: 0 in 0.821s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c217888-6296-4660-807f-4aef6338d3fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc5e25d-65ab-4a86-b86c-5627116be161]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:54 devstack sudo[84071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa
Apr 24 14:42:54 devstack sudo[84071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:54 devstack sudo[84071]: pam_unix(sudo:session): session closed for user root
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa" returned: 0 in 0.616s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:42:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:42:54 devstack sudo[84076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca
Apr 24 14:42:54 devstack sudo[84076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:42:55 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-826370b5-6443-485c-a625-55adf1b3b1a4 tempest-GroupsTest-629430227 None] Group tempest-Group1-1085202773: creating
Apr 24 14:42:55 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-826370b5-6443-485c-a625-55adf1b3b1a4 tempest-GroupsTest-629430227 None] Group tempest-Group1-1085202773: created successfully
Apr 24 14:42:55 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-826370b5-6443-485c-a625-55adf1b3b1a4 tempest-GroupsTest-629430227 None] Create group completed successfully.
Apr 24 14:42:56 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-992fc0d2-b405-41c3-b105-564b5c0707b5 tempest-GroupsTest-629430227 None] Group tempest-Group2-667186104: creating
Apr 24 14:42:56 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-992fc0d2-b405-41c3-b105-564b5c0707b5 tempest-GroupsTest-629430227 None] Group tempest-Group2-667186104: created successfully
Apr 24 14:42:56 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-992fc0d2-b405-41c3-b105-564b5c0707b5 tempest-GroupsTest-629430227 None] Create group completed successfully.
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Flow 'volume_create_manager' (ff5bcca0-a4d1-4420-a181-2596f48b636a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b3e90b-eef9-4434-a019-a52c8f255b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b3e90b-eef9-4434-a019-a52c8f255b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1783316956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c9430a20-a023-48b0-bb3a-bb7011ee26f7,host='devstack@QuobyteHD#QuobyteHD',id=0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc9be6462ed49ef95f26237ba46c2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:58Z,use_quota=True,user_id='ec7ab23ba47740afb1f1b75145c78ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4aa8e14-65d4-4d32-939d-c6937cdfb73d),volume_type_id=f4aa8e14-65d4-4d32-939d-c6937cdfb73d)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6367dc3f-f556-4c5d-a242-e7650ed09f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6367dc3f-f556-4c5d-a242-e7650ed09f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30320fa-f290-4dc0-a6b9-5eac153a0190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30320fa-f290-4dc0-a6b9-5eac153a0190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431', 'volume_name': 'volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bbe6e6-685f-42da-bad3-a164bdfd5cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bbe6e6-685f-42da-bad3-a164bdfd5cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86660fd-4496-4a18-8700-3402a3fcf8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:42:58 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Volume 0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431', 'volume_size': 1}
Apr 24 14:42:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:43:01 devstack sudo[84076]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Flow 'volume_create_manager' (1fa71c72-1ef3-4ba3-8038-20eaaa0b378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a3c68c-1ecd-4eec-be3f-3572bb34c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca" returned: 0 in 6.212s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a3c68c-1ecd-4eec-be3f-3572bb34c01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:01Z,deleted=False,deleted_at=None,display_description='',display_name='ccd0cf31-9729-4277-92db-f1506def8728-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e54789a-7fad-4540-b3d6-1e9d6484adaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c94138402824aad8a4e21ab26a5ea22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:01Z,use_quota=True,user_id='1927a960d3cb4f548fb8eeac064c8b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87e324e-e116-4817-88da-d1e9c1cdeeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87e324e-e116-4817-88da-d1e9c1cdeeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5eabd1-cc35-4ce1-806a-7ed34f71f8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5eabd1-cc35-4ce1-806a-7ed34f71f8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e54789a-7fad-4540-b3d6-1e9d6484adaf', 'volume_name': 'volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01780ff4-ae77-41c0-a014-0df4c4efddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01780ff4-ae77-41c0-a014-0df4c4efddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8145015-b7f2-4bfe-9be5-412116566e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:01 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Volume 4e54789a-7fad-4540-b3d6-1e9d6484adaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf', 'volume_size': 1}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8a39c9-3849-4f47-b572-b2746ccc1c11]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:01 devstack sudo[84102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa
Apr 24 14:43:01 devstack sudo[84102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:01 devstack sudo[84102]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa" returned: 0 in 0.708s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:43:01 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Converted 1024.00 MB image at 164.82 MB/s
Apr 24 14:43:01 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:43:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:01 devstack sudo[84109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca
Apr 24 14:43:01 devstack sudo[84109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:02 devstack sudo[84109]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca" returned: 0 in 0.427s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-656cc50f-26da-4a7f-86f9-3533966332ca" released by "_copy_volume_from_snapshot" :: held 8.975s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-0d232214-aff9-4e0c-b84f-504cae3a7d46-656cc50f-26da-4a7f-86f9-3533966332ca" released by "_create_volume_from_snapshot" :: held 9.047s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.069s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.230s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-581728754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4463a39-ded8-47ce-8e55-941541b95e73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a15130fd7f94bf28ff400de0e5b78cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:54Z,use_quota=True,user_id='55d67a15e4424485a170eec9f666b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Creating volume d4463a39-ded8-47ce-8e55-941541b95e73 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:02 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:02 devstack sudo[84113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73 1073741824
Apr 24 14:43:02 devstack sudo[84113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:02 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-bee31fde-9fc5-4c7a-821d-f777bdfa2efd tempest-GroupSnapshotsTest-1418024490 None] Create group from source-snapshot-18bce2ed-9296-4071-8b2c-4375366dd10a completed successfully.
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-656cc50f-26da-4a7f-86f9-3533966332ca" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-656cc50f-26da-4a7f-86f9-3533966332ca" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:02 devstack sudo[84113]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73 1073741824" returned: 0 in 0.708s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a661a9d3-17b0-4925-b21d-f537cdf5766c]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:03 devstack sudo[84119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73
Apr 24 14:43:03 devstack sudo[84119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:03 devstack sudo[84118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca
Apr 24 14:43:03 devstack sudo[84118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:03 devstack sudo[84119]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73" returned: 0 in 0.498s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.039s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c9430a20-a023-48b0-bb3a-bb7011ee26f7,created_at=2026-04-24T12:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1783316956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c9430a20-a023-48b0-bb3a-bb7011ee26f7,host='devstack@QuobyteHD#QuobyteHD',id=0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc9be6462ed49ef95f26237ba46c2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:42:58Z,use_quota=True,user_id='ec7ab23ba47740afb1f1b75145c78ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4aa8e14-65d4-4d32-939d-c6937cdfb73d),volume_type_id=f4aa8e14-65d4-4d32-939d-c6937cdfb73d)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Creating volume 0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:03 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:03 devstack sudo[84126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431 1073741824
Apr 24 14:43:03 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a48cde6-5d83-407e-add4-bfaa799d19cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4463a39-ded8-47ce-8e55-941541b95e73', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578d882a-1fc1-4ff6-8e51-dc7dd5372db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:03 devstack sudo[84118]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca" returned: 0 in 0.570s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:03 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Volume volume-d4463a39-ded8-47ce-8e55-941541b95e73 (d4463a39-ded8-47ce-8e55-941541b95e73): created successfully
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578d882a-1fc1-4ff6-8e51-dc7dd5372db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Flow 'volume_create_manager' (b947fffe-7207-4eac-8fc0-70f593b6292a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:03 devstack sudo[84128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca
Apr 24 14:43:03 devstack sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:03 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-bbae5a9a-8a6e-487a-921f-0c6cbf8e2c0a tempest-VolumesTestJSON-91512523 None] Created volume successfully.
Apr 24 14:43:04 devstack sudo[84128]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-656cc50f-26da-4a7f-86f9-3533966332ca" returned: 0 in 0.567s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-656cc50f-26da-4a7f-86f9-3533966332ca" released by "delete_volume" :: held 1.224s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['cb0cecb6-8489-48b7-862f-a8aebfe3eb4b'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:04 devstack cinder-volume[81510]: WARNING cinder.quota [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1494491286 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1494491286, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:04 devstack cinder-volume[81510]: WARNING cinder.quota [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1494491286 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1494491286, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['9ac661f4-4440-4923-92f0-45b647b25710', '755e3d08-a328-4d03-958b-a80235ffcb85', 'ed66e18c-8b83-42f6-9be4-b65035dc63b8', '67d5611d-d083-4212-a517-d2e0bd107f6c'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:04 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431 1073741824" returned: 0 in 0.892s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Flow 'volume_create_manager' (45a2bba3-ab6e-4312-a080-bdc735db8692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e341945d-9828-4438-947a-6398470847cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e341945d-9828-4438-947a-6398470847cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1428762656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f6c013-b203-4216-bf63-4737d5d20a99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a15130fd7f94bf28ff400de0e5b78cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:04Z,use_quota=True,user_id='55d67a15e4424485a170eec9f666b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a674d27-f018-429b-bc4c-bcdfbbad8f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a674d27-f018-429b-bc4c-bcdfbbad8f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ce60bd-54f3-43ca-b6be-68184a8ddd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ce60bd-54f3-43ca-b6be-68184a8ddd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f6c013-b203-4216-bf63-4737d5d20a99', 'volume_name': 'volume-e1f6c013-b203-4216-bf63-4737d5d20a99', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e0ff21-e0dd-4c7f-99c4-360d2a6a901f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e0ff21-e0dd-4c7f-99c4-360d2a6a901f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4007f97-7192-4536-ac77-75392492dce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:04 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Volume e1f6c013-b203-4216-bf63-4737d5d20a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f6c013-b203-4216-bf63-4737d5d20a99', 'volume_size': 1}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:04 devstack sudo[84134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431
Apr 24 14:43:04 devstack sudo[84134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:04 devstack sudo[84136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:04 devstack sudo[84136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:04 devstack sudo[84134]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431" returned: 0 in 0.445s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.900s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:01Z,deleted=False,deleted_at=None,display_description='',display_name='ccd0cf31-9729-4277-92db-f1506def8728-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e54789a-7fad-4540-b3d6-1e9d6484adaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c94138402824aad8a4e21ab26a5ea22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:01Z,use_quota=True,user_id='1927a960d3cb4f548fb8eeac064c8b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Creating volume 4e54789a-7fad-4540-b3d6-1e9d6484adaf {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:04 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86660fd-4496-4a18-8700-3402a3fcf8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:05 devstack sudo[84140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf 1073741824
Apr 24 14:43:05 devstack sudo[84140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f40fcf-c23e-4db3-bea3-817dacc44a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:05 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Volume volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431 (0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431): created successfully
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f40fcf-c23e-4db3-bea3-817dacc44a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:05 devstack sudo[84136]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Flow 'volume_create_manager' (ff5bcca0-a4d1-4420-a181-2596f48b636a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.477s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:05 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-0ecf9dc9-73a9-46e0-986f-2dde2f2f3107 tempest-GroupsTest-629430227 None] Created volume successfully.
Apr 24 14:43:05 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2ac47345-87df-480b-871e-e9f306704c4f tempest-GroupSnapshotsTest-1418024490 None] Delete group completed successfully.
Apr 24 14:43:05 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 18bce2ed-9296-4071-8b2c-4375366dd10a: deleting
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 18bce2ed-9296-4071-8b2c-4375366dd10a: deleting {{(pid=81510) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-8c217888-6296-4660-807f-4aef6338d3fa" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-8c217888-6296-4660-807f-4aef6338d3fa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-0d232214-aff9-4e0c-b84f-504cae3a7d46" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-0d232214-aff9-4e0c-b84f-504cae3a7d46" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Deleting offline snapshot 0d232214-aff9-4e0c-b84f-504cae3a7d46 of volume 8c217888-6296-4660-807f-4aef6338d3fa {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] snapshot_file for this snap is: volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e1f7ca-c210-4e58-b60f-b30751c321a0]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:05 devstack sudo[84145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46
Apr 24 14:43:05 devstack sudo[84145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Acquiring lock "cinder-quobyte-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Lock "cinder-quobyte-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431" acquired by "delete_volume" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eecca61-e78a-4610-b223-4961b2c47535]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:05 devstack sudo[84140]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf 1073741824" returned: 0 in 0.750s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:05 devstack sudo[84148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf
Apr 24 14:43:05 devstack sudo[84148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:05 devstack sudo[84147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431
Apr 24 14:43:05 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:06 devstack sudo[84145]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46" returned: 0 in 0.639s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c217888-6296-4660-807f-4aef6338d3fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f0fdf4-ea78-4336-bbdd-80a2b25e4a2c]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:06 devstack sudo[84154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa
Apr 24 14:43:06 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:06 devstack sudo[84148]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf" returned: 0 in 0.492s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.768s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1428762656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f6c013-b203-4216-bf63-4737d5d20a99,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a15130fd7f94bf28ff400de0e5b78cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:04Z,use_quota=True,user_id='55d67a15e4424485a170eec9f666b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Creating volume e1f6c013-b203-4216-bf63-4737d5d20a99 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:06 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:06 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8145015-b7f2-4bfe-9be5-412116566e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:06 devstack sudo[84160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99 1073741824
Apr 24 14:43:06 devstack sudo[84160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74877ef1-ade2-4caf-987a-fe564a661446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431" returned: 0 in 0.610s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:06 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Volume volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf (4e54789a-7fad-4540-b3d6-1e9d6484adaf): created successfully
Apr 24 14:43:06 devstack sudo[84162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431
Apr 24 14:43:06 devstack sudo[84162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74877ef1-ade2-4caf-987a-fe564a661446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Flow 'volume_create_manager' (1fa71c72-1ef3-4ba3-8038-20eaaa0b378b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:06 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-e3480f4a-9ab9-42f2-b332-fab313892d62 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Created volume successfully.
Apr 24 14:43:06 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa" returned: 0 in 0.531s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:06 devstack sudo[84167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46
Apr 24 14:43:06 devstack sudo[84167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:06 devstack sudo[84162]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431" returned: 0 in 0.539s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Lock "cinder-quobyte-0b8ef1b8-7fe7-47a2-8dbf-78e127d3d431" released by "delete_volume" :: held 1.187s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Created reservations ['2d4b6095-fcb0-49ad-bfc5-afeb0337f633'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:06 devstack sudo[84160]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99 1073741824" returned: 0 in 0.686s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:06 devstack cinder-volume[81510]: WARNING cinder.quota [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-185466425 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-185466425, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:06 devstack cinder-volume[81510]: WARNING cinder.quota [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-185466425 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-185466425, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Created reservations ['8054a025-5cc2-4fe3-b1c0-59636e8bdc0c', '47383b87-28ff-4813-a97b-8482ab3c365d', 'd0a1e092-5144-4440-8e77-4bfb5daee1aa', 'd40d694e-2128-4f6f-a4f5-74ab03ef5767'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:07 devstack sudo[84173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99
Apr 24 14:43:07 devstack sudo[84173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:07 devstack sudo[84178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:07 devstack sudo[84178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:07 devstack sudo[84167]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46" returned: 0 in 0.685s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:07 devstack sudo[84180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46
Apr 24 14:43:07 devstack sudo[84180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:07 devstack sudo[84173]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99" returned: 0 in 0.519s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4007f97-7192-4536-ac77-75392492dce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f6c013-b203-4216-bf63-4737d5d20a99', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2498901f-6ec5-4fc6-b893-4b260db8223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:07 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Volume volume-e1f6c013-b203-4216-bf63-4737d5d20a99 (e1f6c013-b203-4216-bf63-4737d5d20a99): created successfully
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2498901f-6ec5-4fc6-b893-4b260db8223d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Flow 'volume_create_manager' (45a2bba3-ab6e-4312-a080-bdc735db8692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:07 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1d325751-09aa-4036-8d6b-5b365009d2d7 tempest-VolumesTestJSON-91512523 None] Created volume successfully.
Apr 24 14:43:07 devstack sudo[84178]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.487s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:07 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-34e60411-e8ac-48c5-8a38-608dea0073b3 tempest-GroupsTest-629430227 None] Delete group completed successfully.
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-ad0083db-1756-40d3-b8c2-90c61a2be2ef tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-ad0083db-1756-40d3-b8c2-90c61a2be2ef tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa3b548-997a-4d4f-b4df-d272de2514aa]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-ad0083db-1756-40d3-b8c2-90c61a2be2ef tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:07 devstack sudo[84192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf
Apr 24 14:43:07 devstack sudo[84192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:07 devstack sudo[84180]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa.0d232214-aff9-4e0c-b84f-504cae3a7d46" returned: 0 in 0.529s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-0d232214-aff9-4e0c-b84f-504cae3a7d46" released by "_delete_snapshot" :: held 2.493s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-8c217888-6296-4660-807f-4aef6338d3fa" released by "delete_snapshot" :: held 2.514s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:07 devstack cinder-volume[81510]: WARNING cinder.quota [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1494491286 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1494491286, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:07 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['5e07de3d-be1a-4954-bb36-9bc936dbb78d', '1629cb41-98d9-46e5-ba37-62a74deddd66', '3590e0c8-77cd-423e-98ce-c5f2e8a09944', '7ff85249-2aa1-494d-86db-2cc900298887'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:08 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-167ef528-9ce7-4ac0-8e1c-bad79539449b tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 18bce2ed-9296-4071-8b2c-4375366dd10a: deleted successfully
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-8f881019-738e-4060-9898-3ef9693000b4 tempest-GroupsTest-629430227 None] Created reservations ['d5048cad-e113-4fa9-a169-412912b0cbb6'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8f881019-738e-4060-9898-3ef9693000b4 tempest-GroupsTest-629430227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8f881019-738e-4060-9898-3ef9693000b4 tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8f881019-738e-4060-9898-3ef9693000b4 tempest-GroupsTest-629430227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8f881019-738e-4060-9898-3ef9693000b4 tempest-GroupsTest-629430227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8f881019-738e-4060-9898-3ef9693000b4 tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8f881019-738e-4060-9898-3ef9693000b4 tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:08 devstack sudo[84198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:08 devstack sudo[84198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:08 devstack sudo[84192]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-ad0083db-1756-40d3-b8c2-90c61a2be2ef tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf" returned: 0 in 0.580s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-ad0083db-1756-40d3-b8c2-90c61a2be2ef tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.596s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-ad0083db-1756-40d3-b8c2-90c61a2be2ef tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d', 'name': 'volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98334c3b-6ae9-4743-a0b0-b6fa00c42e30', 'enforce_multipath': True} {{(pid=81510) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 24 14:43:08 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-7326cb85-9223-48ae-96fb-3153a0f82eec req-ad0083db-1756-40d3-b8c2-90c61a2be2ef tempest-ServerBootFromVolumeStableRescueTest-550446980 None] attachment_update completed successfully.
Apr 24 14:43:08 devstack sudo[84198]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8f881019-738e-4060-9898-3ef9693000b4 tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.462s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-8f881019-738e-4060-9898-3ef9693000b4 tempest-GroupsTest-629430227 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:08 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-8f881019-738e-4060-9898-3ef9693000b4 tempest-GroupsTest-629430227 None] Delete group completed successfully.
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-8c217888-6296-4660-807f-4aef6338d3fa" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-8c217888-6296-4660-807f-4aef6338d3fa" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca16afba-2d87-40d7-917c-73db6470392a]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:09 devstack sudo[84201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa
Apr 24 14:43:09 devstack sudo[84201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Acquiring lock "cinder-e1f6c013-b203-4216-bf63-4737d5d20a99-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:09 devstack sudo[84201]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa" returned: 0 in 0.667s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Lock "cinder-e1f6c013-b203-4216-bf63-4737d5d20a99-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:09 devstack sudo[84206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa
Apr 24 14:43:09 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Acquiring lock "cinder-quobyte-e1f6c013-b203-4216-bf63-4737d5d20a99" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Lock "cinder-quobyte-e1f6c013-b203-4216-bf63-4737d5d20a99" acquired by "delete_volume" :: waited 0.033s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:09 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d90739ed-6c4e-4e6d-be53-325df77f5c6f tempest-GroupsTest-629430227 None] Group tempest-GroupsTest-Group-145794220: creating
Apr 24 14:43:09 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5369d0a-95ab-4bd8-8240-3a2421a9bb2f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:09 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d90739ed-6c4e-4e6d-be53-325df77f5c6f tempest-GroupsTest-629430227 None] Group tempest-GroupsTest-Group-145794220: created successfully
Apr 24 14:43:09 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d90739ed-6c4e-4e6d-be53-325df77f5c6f tempest-GroupsTest-629430227 None] Create group completed successfully.
Apr 24 14:43:09 devstack sudo[84208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99
Apr 24 14:43:09 devstack sudo[84208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:10 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8c217888-6296-4660-807f-4aef6338d3fa" returned: 0 in 0.490s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-8c217888-6296-4660-807f-4aef6338d3fa" released by "delete_volume" :: held 1.232s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['269a053a-03fe-44d9-a5f2-7aaf2b0a29fd'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:10 devstack cinder-volume[81510]: WARNING cinder.db.sqlalchemy.api [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1494491286']
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['945b2990-bc04-40c3-b49b-d67bbcaf4e04', '2545cfa8-ca2f-4516-a885-982324e643b8', 'f459b45d-e7fb-4060-a73b-c9153355201c', '46ca2b29-e945-425b-95ad-e675da56700d'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:10 devstack sudo[84208]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99" returned: 0 in 0.565s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:10 devstack sudo[84214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:10 devstack sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:10 devstack sudo[84215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99
Apr 24 14:43:10 devstack sudo[84215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:10 devstack sudo[84214]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.484s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:10 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-5b5a7dd1-6533-4a77-b1fa-62a70dd0a1b3 tempest-GroupSnapshotsTest-1418024490 None] Delete group completed successfully.
Apr 24 14:43:10 devstack sudo[84215]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e1f6c013-b203-4216-bf63-4737d5d20a99" returned: 0 in 0.490s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Lock "cinder-quobyte-e1f6c013-b203-4216-bf63-4737d5d20a99" released by "delete_volume" :: held 1.105s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:10 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Created reservations ['9416deec-184e-4bc6-92d0-a889759030b4', 'a243d50e-e5c8-4448-977e-0480873f0bb1', '316e7599-5a89-4020-9ce7-a6c3a8544481', '829f1b5b-3959-4042-bf7e-1ba8237de38d'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:11 devstack sudo[84287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:11 devstack sudo[84287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Flow 'volume_create_manager' (30bf03bb-977e-4396-8cc3-113b3c8663af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5177842d-5d6a-4751-b520-b6c308bb2cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5177842d-5d6a-4751-b520-b6c308bb2cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1940665991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7504c9c8-403f-4163-a270-728aca0026b4,host='devstack@QuobyteHD#QuobyteHD',id=c8ba0a4e-ebb5-4cec-a6bf-a98730be7957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc9be6462ed49ef95f26237ba46c2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:11Z,use_quota=True,user_id='ec7ab23ba47740afb1f1b75145c78ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85d7499a-4319-468a-9091-a390d2f00b5c),volume_type_id=85d7499a-4319-468a-9091-a390d2f00b5c)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b1af07-08af-4adb-ba3c-ae74fbe247e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b1af07-08af-4adb-ba3c-ae74fbe247e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7698b7c5-3fa0-48cf-93a1-ce76f81e95ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7698b7c5-3fa0-48cf-93a1-ce76f81e95ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ba0a4e-ebb5-4cec-a6bf-a98730be7957', 'volume_name': 'volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442109ca-b350-42a9-a8f7-9329a4350be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442109ca-b350-42a9-a8f7-9329a4350be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164623a8-0f58-4ac0-802f-b50f7164ecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:11 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Volume c8ba0a4e-ebb5-4cec-a6bf-a98730be7957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957', 'volume_size': 1}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7504c9c8-403f-4163-a270-728aca0026b4,created_at=2026-04-24T12:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1940665991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7504c9c8-403f-4163-a270-728aca0026b4,host='devstack@QuobyteHD#QuobyteHD',id=c8ba0a4e-ebb5-4cec-a6bf-a98730be7957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc9be6462ed49ef95f26237ba46c2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:11Z,use_quota=True,user_id='ec7ab23ba47740afb1f1b75145c78ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85d7499a-4319-468a-9091-a390d2f00b5c),volume_type_id=85d7499a-4319-468a-9091-a390d2f00b5c)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Creating volume c8ba0a4e-ebb5-4cec-a6bf-a98730be7957 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:11 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:11 devstack sudo[84290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957 1073741824
Apr 24 14:43:11 devstack sudo[84290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:11 devstack sudo[84287]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.481s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Deleted volume successfully.
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e0ed4ed1-06af-4bbd-8ae4-5f2772deb710 tempest-VolumesTestJSON-91512523 None] Lock "cinder-e1f6c013-b203-4216-bf63-4737d5d20a99-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-56f68b7c-6859-4b97-bd48-53f69fc5b8b6 tempest-GroupSnapshotsTest-1418024490 None] Group tempest-GroupSnapshotsTest-Group-841430549: creating
Apr 24 14:43:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-56f68b7c-6859-4b97-bd48-53f69fc5b8b6 tempest-GroupSnapshotsTest-1418024490 None] Group tempest-GroupSnapshotsTest-Group-841430549: created successfully
Apr 24 14:43:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-56f68b7c-6859-4b97-bd48-53f69fc5b8b6 tempest-GroupSnapshotsTest-1418024490 None] Create group completed successfully.
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Acquiring lock "cinder-d4463a39-ded8-47ce-8e55-941541b95e73-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Lock "cinder-d4463a39-ded8-47ce-8e55-941541b95e73-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Acquiring lock "cinder-quobyte-d4463a39-ded8-47ce-8e55-941541b95e73" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Lock "cinder-quobyte-d4463a39-ded8-47ce-8e55-941541b95e73" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7c6654-9192-47ad-a551-4f3f5151517e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:12 devstack sudo[84298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73
Apr 24 14:43:12 devstack sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:12 devstack sudo[84290]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957 1073741824" returned: 0 in 0.727s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:12 devstack sudo[84301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957
Apr 24 14:43:12 devstack sudo[84301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:12 devstack sudo[84298]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73" returned: 0 in 0.569s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:12 devstack sudo[84306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73
Apr 24 14:43:12 devstack sudo[84306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:12 devstack sudo[84301]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957" returned: 0 in 0.488s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164623a8-0f58-4ac0-802f-b50f7164ecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2e4d16-b184-477b-a334-f82ddd2965b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:12 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Volume volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957 (c8ba0a4e-ebb5-4cec-a6bf-a98730be7957): created successfully
Apr 24 14:43:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2e4d16-b184-477b-a334-f82ddd2965b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Flow 'volume_create_manager' (30bf03bb-977e-4396-8cc3-113b3c8663af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:12 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-de4a2df9-265a-47b2-89de-cf20b9c93695 tempest-GroupsTest-629430227 None] Created volume successfully.
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:43:13 devstack sudo[84306]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Flow 'volume_create_manager' (cc9f3f47-0541-4016-9981-480c3d394757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dfa3e0-6e13-42cf-a152-77aba282d366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dfa3e0-6e13-42cf-a152-77aba282d366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1617493394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=973eb795-36e1-411c-b583-c5e1581791f2,host='devstack@QuobyteHD#QuobyteHD',id=4f7c4b89-d7b1-40d7-8d79-6bbdf132e046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5aa2fdd11f4f7ab69c44100a421679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:13Z,use_quota=True,user_id='45353ef254a847589f363f133403f9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2325d1-138c-4ace-b47e-a987695af9b9),volume_type_id=1f2325d1-138c-4ace-b47e-a987695af9b9)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca01bdb7-b2a6-4243-b6e5-5eeb62291bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca01bdb7-b2a6-4243-b6e5-5eeb62291bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1cf2e4-ff3f-4b5e-961c-dbb8ab1f7527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1cf2e4-ff3f-4b5e-961c-dbb8ab1f7527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f7c4b89-d7b1-40d7-8d79-6bbdf132e046', 'volume_name': 'volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84528090-75f7-41eb-99f8-e92e3394f35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84528090-75f7-41eb-99f8-e92e3394f35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf98ca0-e1a9-4cc0-8452-2b174251e05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:13 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Volume 4f7c4b89-d7b1-40d7-8d79-6bbdf132e046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046', 'volume_size': 1}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=973eb795-36e1-411c-b583-c5e1581791f2,created_at=2026-04-24T12:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1617493394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=973eb795-36e1-411c-b583-c5e1581791f2,host='devstack@QuobyteHD#QuobyteHD',id=4f7c4b89-d7b1-40d7-8d79-6bbdf132e046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5aa2fdd11f4f7ab69c44100a421679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:13Z,use_quota=True,user_id='45353ef254a847589f363f133403f9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2325d1-138c-4ace-b47e-a987695af9b9),volume_type_id=1f2325d1-138c-4ace-b47e-a987695af9b9)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Creating volume 4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:13 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d4463a39-ded8-47ce-8e55-941541b95e73" returned: 0 in 0.582s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:13 devstack sudo[84310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 1073741824
Apr 24 14:43:13 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Lock "cinder-quobyte-d4463a39-ded8-47ce-8e55-941541b95e73" released by "delete_volume" :: held 1.198s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Created reservations ['60307adf-f6a6-4ca5-916f-bfcfa86eb33f', '84edc218-846f-4535-9fcb-b350edfa8f76', 'c601b8f1-38c4-4c05-bec8-ce89ec5e71c7', 'd42e81d7-60ec-4db7-826d-f222e5f46286'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:13 devstack sudo[84629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:13 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:13 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 1073741824" returned: 0 in 0.692s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:13 devstack sudo[84638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046
Apr 24 14:43:13 devstack sudo[84638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:13 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.698s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:13 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:14 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Deleted volume successfully.
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Flow 'volume_create_manager' (3f391ab6-988b-4874-9122-7d3bc2f2fae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cac009-ae25-49e7-8b8b-fa45eefe7d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cac009-ae25-49e7-8b8b-fa45eefe7d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142547409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7504c9c8-403f-4163-a270-728aca0026b4,host='devstack@QuobyteHD#QuobyteHD',id=ba8d68a2-2d85-4543-a8a3-868d04c53442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc9be6462ed49ef95f26237ba46c2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:14Z,use_quota=True,user_id='ec7ab23ba47740afb1f1b75145c78ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85d7499a-4319-468a-9091-a390d2f00b5c),volume_type_id=85d7499a-4319-468a-9091-a390d2f00b5c)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806d39c9-b2f9-49a1-a812-5cb2afecdfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806d39c9-b2f9-49a1-a812-5cb2afecdfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de7041f-476d-4a7c-ac49-36c46b674487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de7041f-476d-4a7c-ac49-36c46b674487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8d68a2-2d85-4543-a8a3-868d04c53442', 'volume_name': 'volume-ba8d68a2-2d85-4543-a8a3-868d04c53442', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c536db8-7771-421a-a6f8-06c18df1afa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c536db8-7771-421a-a6f8-06c18df1afa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7225ab1-4d5f-4c9f-8188-ece5c32da215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:14 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Volume ba8d68a2-2d85-4543-a8a3-868d04c53442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8d68a2-2d85-4543-a8a3-868d04c53442', 'volume_size': 1}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-62771ee5-3e78-4444-8786-1f063d6c6300 tempest-VolumesTestJSON-91512523 None] Lock "cinder-d4463a39-ded8-47ce-8e55-941541b95e73-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Acquiring lock "cinder-271fb563-fe62-463d-b7c4-afdeaa43e73e-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Lock "cinder-271fb563-fe62-463d-b7c4-afdeaa43e73e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Acquiring lock "cinder-quobyte-271fb563-fe62-463d-b7c4-afdeaa43e73e" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Lock "cinder-quobyte-271fb563-fe62-463d-b7c4-afdeaa43e73e" acquired by "delete_volume" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5e1e4d-14ec-47ab-bef0-882df1e8ee9b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:14 devstack sudo[84646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e
Apr 24 14:43:14 devstack sudo[84646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:14 devstack sudo[84638]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046" returned: 0 in 0.524s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7504c9c8-403f-4163-a270-728aca0026b4,created_at=2026-04-24T12:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142547409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7504c9c8-403f-4163-a270-728aca0026b4,host='devstack@QuobyteHD#QuobyteHD',id=ba8d68a2-2d85-4543-a8a3-868d04c53442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc9be6462ed49ef95f26237ba46c2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:14Z,use_quota=True,user_id='ec7ab23ba47740afb1f1b75145c78ce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85d7499a-4319-468a-9091-a390d2f00b5c),volume_type_id=85d7499a-4319-468a-9091-a390d2f00b5c)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Creating volume ba8d68a2-2d85-4543-a8a3-868d04c53442 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:14 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf98ca0-e1a9-4cc0-8452-2b174251e05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429e362b-a6ad-4abd-a4dd-adae2ff464ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:14 devstack sudo[84651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442 1073741824
Apr 24 14:43:14 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:14 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Volume volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 (4f7c4b89-d7b1-40d7-8d79-6bbdf132e046): created successfully
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429e362b-a6ad-4abd-a4dd-adae2ff464ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:14 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Flow 'volume_create_manager' (cc9f3f47-0541-4016-9981-480c3d394757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:14 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d6c82bd8-753c-4c3e-8949-3af11ecccc70 tempest-GroupSnapshotsTest-1418024490 None] Created volume successfully.
Apr 24 14:43:15 devstack sudo[84646]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e" returned: 0 in 0.898s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:15 devstack sudo[84683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e
Apr 24 14:43:15 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:15 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442 1073741824" returned: 0 in 0.924s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:15 devstack sudo[84690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442
Apr 24 14:43:15 devstack sudo[84690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:15 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:43:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Flow 'volume_create_manager' (bc55ebf5-f6f9-4f98-9ffa-1a7245dfd262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447c183c-75cb-48b0-af68-eeb29fab57ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447c183c-75cb-48b0-af68-eeb29fab57ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1573191133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=973eb795-36e1-411c-b583-c5e1581791f2,host='devstack@QuobyteHD#QuobyteHD',id=cd5061b1-4090-4354-8823-b844a1c940b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5aa2fdd11f4f7ab69c44100a421679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:16Z,use_quota=True,user_id='45353ef254a847589f363f133403f9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2325d1-138c-4ace-b47e-a987695af9b9),volume_type_id=1f2325d1-138c-4ace-b47e-a987695af9b9)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e78a1d2-85a3-48ad-8b21-3ed068a86dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e78a1d2-85a3-48ad-8b21-3ed068a86dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef1ef05-4974-43bc-81e7-87d7ec703711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef1ef05-4974-43bc-81e7-87d7ec703711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd5061b1-4090-4354-8823-b844a1c940b8', 'volume_name': 'volume-cd5061b1-4090-4354-8823-b844a1c940b8', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4833fb-43b6-4aa0-bed4-2d9352feeae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4833fb-43b6-4aa0-bed4-2d9352feeae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f71be5e-0dd8-419f-b98b-678496512f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:16 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Volume cd5061b1-4090-4354-8823-b844a1c940b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd5061b1-4090-4354-8823-b844a1c940b8', 'volume_size': 1}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:16 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271fb563-fe62-463d-b7c4-afdeaa43e73e" returned: 0 in 0.909s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Lock "cinder-quobyte-271fb563-fe62-463d-b7c4-afdeaa43e73e" released by "delete_volume" :: held 1.867s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Created reservations ['9e083a77-1845-4bc3-9c58-48fdd74c5e79', 'f0ddc01b-3e5a-4306-a6df-39635fd05818', 'e783c409-282b-47c3-98d2-3879a928b7fe', 'c89df697-9364-4748-b0f6-c5d1a73839e4'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:16 devstack sudo[84695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:16 devstack sudo[84695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:16 devstack sudo[84690]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442" returned: 0 in 0.928s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=973eb795-36e1-411c-b583-c5e1581791f2,created_at=2026-04-24T12:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1573191133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=973eb795-36e1-411c-b583-c5e1581791f2,host='devstack@QuobyteHD#QuobyteHD',id=cd5061b1-4090-4354-8823-b844a1c940b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5aa2fdd11f4f7ab69c44100a421679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:16Z,use_quota=True,user_id='45353ef254a847589f363f133403f9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2325d1-138c-4ace-b47e-a987695af9b9),volume_type_id=1f2325d1-138c-4ace-b47e-a987695af9b9)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Creating volume cd5061b1-4090-4354-8823-b844a1c940b8 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:16 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7225ab1-4d5f-4c9f-8188-ece5c32da215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8d68a2-2d85-4543-a8a3-868d04c53442', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7dc077-93d3-4ad3-86f8-4d8500260abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:16 devstack sudo[84697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8 1073741824
Apr 24 14:43:16 devstack sudo[84697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:16 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Volume volume-ba8d68a2-2d85-4543-a8a3-868d04c53442 (ba8d68a2-2d85-4543-a8a3-868d04c53442): created successfully
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7dc077-93d3-4ad3-86f8-4d8500260abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Flow 'volume_create_manager' (3f391ab6-988b-4874-9122-7d3bc2f2fae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:16 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-004dfb57-f67c-4bd0-ad28-10b5af68e8cb tempest-GroupsTest-629430227 None] Created volume successfully.
Apr 24 14:43:16 devstack sudo[84695]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.623s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:16 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Deleted volume successfully.
Apr 24 14:43:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fedc1f9b-8745-499d-a937-61db4dcd24a7 tempest-VolumesTestJSON-91512523 None] Lock "cinder-271fb563-fe62-463d-b7c4-afdeaa43e73e-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:17 devstack sudo[84697]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8 1073741824" returned: 0 in 0.908s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:17 devstack sudo[84703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8
Apr 24 14:43:17 devstack sudo[84703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:17 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-50e0eaa3-dc2c-4761-98dc-4a1b8232d929 tempest-GroupsTest-629430227 None] Update group completed successfully.
Apr 24 14:43:17 devstack sudo[84703]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8" returned: 0 in 0.635s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f71be5e-0dd8-419f-b98b-678496512f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd5061b1-4090-4354-8823-b844a1c940b8', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa26a85-0867-4c02-bdf3-c1161dad52f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:18 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Volume volume-cd5061b1-4090-4354-8823-b844a1c940b8 (cd5061b1-4090-4354-8823-b844a1c940b8): created successfully
Apr 24 14:43:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa26a85-0867-4c02-bdf3-c1161dad52f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Flow 'volume_create_manager' (bc55ebf5-f6f9-4f98-9ffa-1a7245dfd262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:18 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-286b45b7-6483-4dea-b601-9a667dfabfe4 tempest-GroupSnapshotsTest-1418024490 None] Created volume successfully.
Apr 24 14:43:18 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-3d782cbd-2855-473b-9807-3c420275456d tempest-GroupsTest-629430227 None] Update group completed successfully.
Apr 24 14:43:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2da2e6e4-37ee-4fd8-9bc0-bc616d325247 tempest-GroupSnapshotsTest-1418024490 None] Update group completed successfully.
Apr 24 14:43:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Acquiring lock "cinder-quobyte-ba8d68a2-2d85-4543-a8a3-868d04c53442" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Lock "cinder-quobyte-ba8d68a2-2d85-4543-a8a3-868d04c53442" acquired by "delete_volume" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:20 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91d88a4-be2c-4829-8410-01a75fadedc2]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:20 devstack sudo[84706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442
Apr 24 14:43:20 devstack sudo[84706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:20 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-0b530406-1a05-4575-ba55-91ed2159b8c9 tempest-GroupSnapshotsTest-1418024490 None] Update group completed successfully.
Apr 24 14:43:21 devstack sudo[84706]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442" returned: 0 in 0.604s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:21 devstack sudo[84711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442
Apr 24 14:43:21 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:21 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ba8d68a2-2d85-4543-a8a3-868d04c53442" returned: 0 in 0.610s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Lock "cinder-quobyte-ba8d68a2-2d85-4543-a8a3-868d04c53442" released by "delete_volume" :: held 1.288s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Acquiring lock "cinder-quobyte-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Lock "cinder-quobyte-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957" acquired by "delete_volume" :: waited 0.033s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:21 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca06437-575b-446f-a1d0-3d913bd9d349]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:21 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-345b06fa-7fa7-47fd-b47e-b06161ad3099 tempest-GroupSnapshotsTest-1418024490 None] Update group completed successfully.
Apr 24 14:43:21 devstack sudo[84748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957
Apr 24 14:43:21 devstack sudo[84748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:22 devstack sudo[84748]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957" returned: 0 in 0.556s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:22 devstack sudo[84754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957
Apr 24 14:43:22 devstack sudo[84754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:22 devstack sudo[84754]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957" returned: 0 in 0.625s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Lock "cinder-quobyte-c8ba0a4e-ebb5-4cec-a6bf-a98730be7957" released by "delete_volume" :: held 1.243s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:23 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Created reservations ['bee67da8-08a8-4bb3-870f-00c3f55e2942'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:23 devstack cinder-volume[81510]: WARNING cinder.quota [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-732160081 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-732160081, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:23 devstack cinder-volume[81510]: WARNING cinder.quota [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-732160081 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-732160081, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:23 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-307da7c7-6ca7-47f8-851f-dc1a66c7615e tempest-GroupSnapshotsTest-1418024490 None] Update group completed successfully.
Apr 24 14:43:23 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Created reservations ['aa0cab65-0965-4b92-9355-9ee381dbc939', '2d22d3c7-9284-4f78-a90b-6bcdacfb67b4', '5bc0ebba-96d8-4605-bc63-2166086ec538', 'eabee3ec-28b0-4e4c-8f93-f0774a01b81e'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:23 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Created reservations ['00335ab2-b4bb-4cc6-8eda-aacdce3e212f', '37907d9a-05c7-4a2d-a7b2-16d6256257fa', '873d66e0-5734-48f8-973f-077efa1ba4db', '1efbff4d-6ef7-4fb8-bf26-c4e147dff9fd'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:23 devstack sudo[84782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:23 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:24 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.551s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:24 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6b284e76-174c-4b6f-8559-0cf6a7ddeec6 tempest-GroupsTest-629430227 None] Delete group completed successfully.
Apr 24 14:43:24 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] GroupSnapshot 2e36fa45-c57c-4f75-8d0b-3c4c448b8302: creating.
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Flow 'volume_create_manager' (1cdcda73-4e78-4557-bf99-e92c9b0ebf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6d116b-6ff9-436e-b4b8-5f7b14c7e42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6d116b-6ff9-436e-b4b8-5f7b14c7e42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-283090682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1304a1-52cd-45a0-8ffb-2005bbc66de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27dc62b94b44209a29b86b71808442d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:25Z,use_quota=True,user_id='0354e7af21aa451c81d50912342d0a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d427e093-93e3-453c-bf73-1f96b39ac552),volume_type_id=d427e093-93e3-453c-bf73-1f96b39ac552)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5092dc-0eeb-425e-8bdb-c92f9a50a3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5092dc-0eeb-425e-8bdb-c92f9a50a3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7935d062-88f0-47e6-97e8-7e31f937bca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7935d062-88f0-47e6-97e8-7e31f937bca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1304a1-52cd-45a0-8ffb-2005bbc66de8', 'volume_name': 'volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb87ea53-81f6-4503-a8ec-08846ce390b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb87ea53-81f6-4503-a8ec-08846ce390b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d79276-fa00-496f-9c7e-3e72b33a6170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:24 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Volume 8d1304a1-52cd-45a0-8ffb-2005bbc66de8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8', 'volume_size': 1}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-283090682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1304a1-52cd-45a0-8ffb-2005bbc66de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27dc62b94b44209a29b86b71808442d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:25Z,use_quota=True,user_id='0354e7af21aa451c81d50912342d0a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d427e093-93e3-453c-bf73-1f96b39ac552),volume_type_id=d427e093-93e3-453c-bf73-1f96b39ac552)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Creating volume 8d1304a1-52cd-45a0-8ffb-2005bbc66de8 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:24 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:25 devstack sudo[84786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8 1073741824
Apr 24 14:43:25 devstack sudo[84786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Group snapshot 2e36fa45-c57c-4f75-8d0b-3c4c448b8302: creating. {{(pid=81510) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 14:43:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:25 devstack sudo[84786]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8 1073741824" returned: 0 in 0.733s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:25 devstack sudo[84805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8
Apr 24 14:43:25 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:26 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8" returned: 0 in 0.503s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.212s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d79276-fa00-496f-9c7e-3e72b33a6170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e419467-5745-4fe5-acdd-9a9e19ea3530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Creating offline snapshot 13e33d4e-ef98-4f02-badb-6ee575df748e of volume cd5061b1-4090-4354-8823-b844a1c940b8 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:43:26 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Volume volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8 (8d1304a1-52cd-45a0-8ffb-2005bbc66de8): created successfully
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e419467-5745-4fe5-acdd-9a9e19ea3530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Flow 'volume_create_manager' (1cdcda73-4e78-4557-bf99-e92c9b0ebf3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ab925f-0505-4b75-ac97-23106022e0ce]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:26 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-bb319d27-f33a-4d7f-bff0-706dbdf206bd tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Created volume successfully.
Apr 24 14:43:26 devstack sudo[84808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8
Apr 24 14:43:26 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:26 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8" returned: 0 in 0.637s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:26 devstack sudo[84813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e 1G
Apr 24 14:43:26 devstack sudo[84813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cd75924e-3f4a-447a-ba57-459afc4fc9d4 tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cd75924e-3f4a-447a-ba57-459afc4fc9d4 tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:27 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cd75924e-3f4a-447a-ba57-459afc4fc9d4 tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:27 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cd75924e-3f4a-447a-ba57-459afc4fc9d4 tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cd75924e-3f4a-447a-ba57-459afc4fc9d4 tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd75924e-3f4a-447a-ba57-459afc4fc9d4 tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:27 devstack sudo[84817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:27 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:27 devstack sudo[84813]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e 1G" returned: 0 in 0.749s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5061b1-4090-4354-8823-b844a1c940b8 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:27 devstack sudo[84820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5061b1-4090-4354-8823-b844a1c940b8 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e
Apr 24 14:43:27 devstack sudo[84820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:27 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd75924e-3f4a-447a-ba57-459afc4fc9d4 tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.536s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:27 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-cd75924e-3f4a-447a-ba57-459afc4fc9d4 tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:28 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-cd75924e-3f4a-447a-ba57-459afc4fc9d4 tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Retype volume completed successfully.
Apr 24 14:43:28 devstack sudo[84820]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5061b1-4090-4354-8823-b844a1c940b8 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e" returned: 0 in 0.571s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:28 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:43:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:28 devstack sudo[84827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e
Apr 24 14:43:28 devstack sudo[84827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Acquiring lock "cinder-8d1304a1-52cd-45a0-8ffb-2005bbc66de8-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "cinder-8d1304a1-52cd-45a0-8ffb-2005bbc66de8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Acquiring lock "cinder-quobyte-8d1304a1-52cd-45a0-8ffb-2005bbc66de8" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "cinder-quobyte-8d1304a1-52cd-45a0-8ffb-2005bbc66de8" acquired by "delete_volume" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:28 devstack sudo[84827]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e" returned: 0 in 0.535s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:28 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab39c744-0e0f-4625-96f3-eaf1648e8cf7]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:28 devstack sudo[84831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.info
Apr 24 14:43:28 devstack sudo[84831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:28 devstack sudo[84830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8
Apr 24 14:43:28 devstack sudo[84830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:29 devstack sudo[84831]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.info" returned: 0 in 0.550s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:29 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:43:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:29 devstack sudo[84838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.info
Apr 24 14:43:29 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:29 devstack sudo[84830]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8" returned: 0 in 0.667s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:29 devstack sudo[84840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8
Apr 24 14:43:29 devstack sudo[84840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:30 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.info" returned: 0 in 0.597s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.757s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:30 devstack sudo[84840]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Creating offline snapshot e8a138fe-c0a1-4894-bab1-f4b787c1e250 of volume 4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8d1304a1-52cd-45a0-8ffb-2005bbc66de8" returned: 0 in 0.568s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebc53bc-ecab-4c20-b1cf-80383b72925b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "cinder-quobyte-8d1304a1-52cd-45a0-8ffb-2005bbc66de8" released by "delete_volume" :: held 1.312s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:30 devstack cinder-volume[81510]: WARNING cinder.quota [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:30 devstack cinder-volume[81510]: WARNING cinder.quota [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:30 devstack sudo[84848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046
Apr 24 14:43:30 devstack sudo[84848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Created reservations ['af4f8911-3b6f-464a-ad2d-b60d63eab936', 'ea12aecb-f1fe-4348-9813-2e2b99a45ba1', '6a645a10-6b0c-4b37-825a-5bcb9188865b', '2d7a9d77-f3ed-4d0c-8441-90256995f196'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:30 devstack sudo[84852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:30 devstack sudo[84852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:30 devstack sudo[84848]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046" returned: 0 in 0.638s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:30 devstack sudo[84885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250 1G
Apr 24 14:43:30 devstack sudo[84885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:30 devstack sudo[84852]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.644s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:30 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:30 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Deleted volume successfully.
Apr 24 14:43:31 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39b14275-dc09-4396-8010-2670c1a4129b tempest-VolumeRetypeWithoutMigrationTest-1718011586 None] Lock "cinder-8d1304a1-52cd-45a0-8ffb-2005bbc66de8-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:31 devstack sudo[84885]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250 1G" returned: 0 in 0.972s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:31 devstack sudo[84915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250
Apr 24 14:43:31 devstack sudo[84915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:32 devstack sudo[84915]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250" returned: 0 in 1.112s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:32 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:43:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:32 devstack sudo[84933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250
Apr 24 14:43:32 devstack sudo[84933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:33 devstack sudo[84933]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250" returned: 0 in 0.810s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:33 devstack sudo[84936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.info
Apr 24 14:43:33 devstack sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:34 devstack sudo[84936]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.info" returned: 0 in 0.835s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:34 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:43:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:34 devstack sudo[84939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.info
Apr 24 14:43:34 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:35 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.info" returned: 0 in 0.860s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.400s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:35 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-011d739f-5db8-4a7d-b32b-3098a677f67e tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 2e36fa45-c57c-4f75-8d0b-3c4c448b8302: created successfully
Apr 24 14:43:36 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 2e36fa45-c57c-4f75-8d0b-3c4c448b8302: deleting
Apr 24 14:43:36 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 2e36fa45-c57c-4f75-8d0b-3c4c448b8302: deleting {{(pid=81510) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 14:43:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-cd5061b1-4090-4354-8823-b844a1c940b8" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-cd5061b1-4090-4354-8823-b844a1c940b8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-13e33d4e-ef98-4f02-badb-6ee575df748e" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-13e33d4e-ef98-4f02-badb-6ee575df748e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Deleting offline snapshot 13e33d4e-ef98-4f02-badb-6ee575df748e of volume cd5061b1-4090-4354-8823-b844a1c940b8 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:43:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] snapshot_file for this snap is: volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:43:36 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ee5960-9a56-44e0-8b26-8fc7a1caf4d0]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:37 devstack sudo[84948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e
Apr 24 14:43:37 devstack sudo[84948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Flow 'volume_create_manager' (8a62103f-45c4-4eb7-94b5-1bf1ba22595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb930d1-b1e3-4d06-824c-ae0e53833747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:37 devstack sudo[84948]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e" returned: 0 in 1.022s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd5061b1-4090-4354-8823-b844a1c940b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28fbaf5-424d-45f5-b2f5-1626d248f1ec]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb930d1-b1e3-4d06-824c-ae0e53833747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-570859754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf5d354-ebbb-4b6c-bf9b-b8983af8667b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a25da4dd174124a39e63ee503ba0e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:38Z,use_quota=True,user_id='50546983272f45e291b1cd381cb993f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f857dba-057d-4f0c-9e10-a36900736271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f857dba-057d-4f0c-9e10-a36900736271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d9acfa-a150-4e51-8f9f-00ca5cef9faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d9acfa-a150-4e51-8f9f-00ca5cef9faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf5d354-ebbb-4b6c-bf9b-b8983af8667b', 'volume_name': 'volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e30314c-0ad8-40cf-9788-5b0555511279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e30314c-0ad8-40cf-9788-5b0555511279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78f8104-53c1-4405-ac33-ed007c47491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:37 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b', 'volume_size': 1}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-570859754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf5d354-ebbb-4b6c-bf9b-b8983af8667b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a25da4dd174124a39e63ee503ba0e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:38Z,use_quota=True,user_id='50546983272f45e291b1cd381cb993f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Creating volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:37 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:38 devstack sudo[84975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b 1073741824
Apr 24 14:43:38 devstack sudo[84975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:38 devstack sudo[84974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8
Apr 24 14:43:38 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:38 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8" returned: 0 in 0.802s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:38 devstack sudo[84991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e
Apr 24 14:43:38 devstack sudo[84991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:38 devstack sudo[84975]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b 1073741824" returned: 0 in 0.789s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:38 devstack sudo[84997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b
Apr 24 14:43:38 devstack sudo[84997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:39 devstack sudo[84991]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e" returned: 0 in 0.655s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:39 devstack sudo[85007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e
Apr 24 14:43:39 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:39 devstack sudo[84997]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" returned: 0 in 0.613s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78f8104-53c1-4405-ac33-ed007c47491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435abb03-30ba-400d-a53a-c951873e5539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:39 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Volume volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b (3cf5d354-ebbb-4b6c-bf9b-b8983af8667b): created successfully
Apr 24 14:43:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435abb03-30ba-400d-a53a-c951873e5539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Flow 'volume_create_manager' (8a62103f-45c4-4eb7-94b5-1bf1ba22595f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:39 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-82eb50b4-a98f-4eb8-a697-dc768d2b74b9 tempest-SnapshotsActionsTest-1081268019 None] Created volume successfully.
Apr 24 14:43:40 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8.13e33d4e-ef98-4f02-badb-6ee575df748e" returned: 0 in 0.768s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-13e33d4e-ef98-4f02-badb-6ee575df748e" released by "_delete_snapshot" :: held 3.386s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-cd5061b1-4090-4354-8823-b844a1c940b8" released by "delete_snapshot" :: held 3.423s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=173,cinder:UPDATE=188,cinder:DELETE=6,cinder:INSERT=24 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046" acquired by "delete_snapshot" :: waited 0.046s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-e8a138fe-c0a1-4894-bab1-f4b787c1e250" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-e8a138fe-c0a1-4894-bab1-f4b787c1e250" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Deleting offline snapshot e8a138fe-c0a1-4894-bab1-f4b787c1e250 of volume 4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] snapshot_file for this snap is: volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4ecc09-2978-4b09-aa61-53981d5a6dc6]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:40 devstack sudo[85037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250
Apr 24 14:43:40 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] Creating offline snapshot fc58cb08-519a-4722-ac80-a18acba8a849 of volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a9573f-e366-4c94-84a7-91fe6827d93e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:40 devstack sudo[85039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b
Apr 24 14:43:40 devstack sudo[85039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:41 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250" returned: 0 in 0.945s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:43:41 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d45bfdb-5656-47ec-913d-c26c2b29dc19]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:41 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=170,cinder:UPDATE=164,cinder:DELETE=12,cinder:INSERT=49 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:43:41 devstack sudo[85045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046
Apr 24 14:43:41 devstack sudo[85045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:41 devstack sudo[85039]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" returned: 0 in 1.095s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:41 devstack sudo[85050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 1G
Apr 24 14:43:41 devstack sudo[85050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:42 devstack sudo[85045]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046" returned: 0 in 0.822s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:42 devstack sudo[85056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250
Apr 24 14:43:42 devstack sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:42 devstack sudo[85050]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 1G" returned: 0 in 0.886s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:42 devstack sudo[85064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:43:42 devstack sudo[85064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:42 devstack sudo[85056]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250" returned: 0 in 0.778s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:42 devstack sudo[85069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250
Apr 24 14:43:42 devstack sudo[85069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:43 devstack sudo[85064]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.619s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:43 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 is being set with open permissions: ugo+rw
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:43 devstack sudo[85074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:43:43 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:43 devstack sudo[85076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:43 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:43 devstack sudo[85069]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046.e8a138fe-c0a1-4894-bab1-f4b787c1e250" returned: 0 in 0.554s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-e8a138fe-c0a1-4894-bab1-f4b787c1e250" released by "_delete_snapshot" :: held 3.226s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046" released by "delete_snapshot" :: held 3.274s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:43 devstack cinder-volume[81510]: WARNING cinder.quota [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1615988519 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1615988519, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:43 devstack cinder-volume[81510]: WARNING cinder.quota [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1615988519 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1615988519, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['aeedc63e-ac1f-4a00-afd1-d695f670fbbd', '31c34ac9-a21c-4d47-809f-0ff61988a421', '3d3b8201-66ee-4f9f-a02d-0582e7cc37d4', '265a978d-a923-4646-854e-c2a698f50edf'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['921b9bf3-964b-4d65-a2cc-881d4838977b', '5364c236-6b64-4368-85e1-09c3801ec7de', 'd8b3acc3-5cf4-4b50-ae90-6657dcad20ef', '92ed5e77-53fe-447c-a272-01a4bc40bcc3'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:43 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.606s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:43 devstack sudo[85081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.info
Apr 24 14:43:43 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-0d7f209d-c3bc-4424-8676-132a89b84314 tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 2e36fa45-c57c-4f75-8d0b-3c4c448b8302: deleted successfully
Apr 24 14:43:44 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.657s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:44 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:44 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.info" returned: 0 in 0.527s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:44 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.info is being set with open permissions: ugo+rw
Apr 24 14:43:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:44 devstack sudo[85084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.info
Apr 24 14:43:44 devstack sudo[85084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046" acquired by "delete_volume" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:44 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[49566c3c-1c16-41d0-adf5-f57e5368021c]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:44 devstack sudo[85086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046
Apr 24 14:43:44 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:45 devstack sudo[85084]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.info" returned: 0 in 0.556s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.410s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:45 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-21b0fca4-f6e3-4492-84b7-6ed41fecc1e2 tempest-SnapshotsActionsTest-1081268019 None] Create snapshot completed successfully
Apr 24 14:43:45 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046" returned: 0 in 0.615s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:45 devstack sudo[85092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046
Apr 24 14:43:45 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:45 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046" returned: 0 in 0.514s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:45 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-4f7c4b89-d7b1-40d7-8d79-6bbdf132e046" released by "delete_volume" :: held 1.208s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:45 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-cd5061b1-4090-4354-8823-b844a1c940b8" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-cd5061b1-4090-4354-8823-b844a1c940b8" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:46 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec998c9-08bb-4fae-9715-083e5909a065]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:46 devstack sudo[85095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8
Apr 24 14:43:46 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] Creating offline snapshot 2a18882f-27c3-4d49-b660-edde35fcbdcf of volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:43:46 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ace7c27-127c-4f66-9f2a-78a3dbb88f33]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:46 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8" returned: 0 in 0.689s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:46 devstack sudo[85102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8
Apr 24 14:43:46 devstack sudo[85102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:46 devstack sudo[85101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:43:46 devstack sudo[85101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:47 devstack sudo[85102]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd5061b1-4090-4354-8823-b844a1c940b8" returned: 0 in 0.782s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:47 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-cd5061b1-4090-4354-8823-b844a1c940b8" released by "delete_volume" :: held 1.572s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:47 devstack sudo[85101]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.883s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:43:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:47 devstack sudo[85110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf 1G
Apr 24 14:43:47 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:47 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['9dfc9133-42ab-4443-bc89-a5ee7b3a5706'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:47 devstack cinder-volume[81510]: WARNING cinder.quota [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1615988519 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1615988519, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:43:47 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['9ac8eec6-21ad-45bf-89c8-ecc7f805e44c', 'f4072406-4f43-4dd7-9529-d76c0e5ea897', 'f9424da0-4a61-4add-baec-517fb66112ee', '898cea20-23b2-480b-a75e-ea746d7240b9'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:48 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['34ca6b4c-9068-40ce-a19f-3d131c068388', '286bf33e-a5f6-4aa8-8a37-cfe493ff9d8e', '716cce57-8b65-4570-b686-5b6954469586', '68a9a90f-0f79-4dec-91b7-13a029a80c36'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:48 devstack sudo[85117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:48 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:48 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf 1G" returned: 0 in 1.195s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:48 devstack sudo[85122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf
Apr 24 14:43:48 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:49 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-3c98901c-4b76-4944-971e-bb1564d508d4 tempest-GroupSnapshotsTest-1418024490 None] Group tempest-GroupSnapshotsTest-Group-1065702213: creating
Apr 24 14:43:49 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-3c98901c-4b76-4944-971e-bb1564d508d4 tempest-GroupSnapshotsTest-1418024490 None] Group tempest-GroupSnapshotsTest-Group-1065702213: created successfully
Apr 24 14:43:49 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-3c98901c-4b76-4944-971e-bb1564d508d4 tempest-GroupSnapshotsTest-1418024490 None] Create group completed successfully.
Apr 24 14:43:49 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.998s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:49 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:49 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-adbf56f6-984d-42eb-9a1f-e8fdcaf54ede tempest-GroupSnapshotsTest-1418024490 None] Delete group completed successfully.
Apr 24 14:43:49 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf" returned: 0 in 0.818s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:49 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf is being set with open permissions: ugo+rw
Apr 24 14:43:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:49 devstack sudo[85142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf
Apr 24 14:43:49 devstack sudo[85142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:43:50 devstack sudo[85142]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Flow 'volume_create_manager' (6dd4e43f-02c7-458a-91cc-81bbc9a2d6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88a3a6c-1995-42ff-a182-71e115e4220a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf" returned: 0 in 0.633s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88a3a6c-1995-42ff-a182-71e115e4220a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-882651914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211f6ddd-aaa5-4035-ab9a-512de291f332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e57f89ccc941f9a9958913eafafcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:50Z,use_quota=True,user_id='b75ccb97443f48a3b2aaa9db68bd1c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23a47d8-7e8c-478f-871c-0af01ac61ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23a47d8-7e8c-478f-871c-0af01ac61ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98be108-b201-4ed0-ac61-9c1fff91a2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98be108-b201-4ed0-ac61-9c1fff91a2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211f6ddd-aaa5-4035-ab9a-512de291f332', 'volume_name': 'volume-211f6ddd-aaa5-4035-ab9a-512de291f332', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b477fa1-7dc0-4090-a183-5939dbd1a10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b477fa1-7dc0-4090-a183-5939dbd1a10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7038a9e1-8984-4e78-adaf-3200702f19f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:50 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Volume 211f6ddd-aaa5-4035-ab9a-512de291f332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211f6ddd-aaa5-4035-ab9a-512de291f332', 'volume_size': 1}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.671s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.040s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-882651914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211f6ddd-aaa5-4035-ab9a-512de291f332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e57f89ccc941f9a9958913eafafcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:50Z,use_quota=True,user_id='b75ccb97443f48a3b2aaa9db68bd1c3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Creating volume 211f6ddd-aaa5-4035-ab9a-512de291f332 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:50 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:50 devstack sudo[85150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332 1073741824
Apr 24 14:43:50 devstack sudo[85150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:50 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-825d20bf-7eed-498a-9f51-f72fc8c9ea21 tempest-SnapshotsActionsTest-1081268019 None] Create snapshot completed successfully
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Flow 'volume_create_manager' (ab9afeb8-7b75-4741-b942-38706f6b84b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15577285-a8cc-4796-a24f-41771a9d458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15577285-a8cc-4796-a24f-41771a9d458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1076844346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=61f427a3-3624-4b50-a4bb-d88905668759,host='devstack@QuobyteHD#QuobyteHD',id=fdb5a7f0-5ccb-44be-b2e2-86ba0da36725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5aa2fdd11f4f7ab69c44100a421679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:51Z,use_quota=True,user_id='45353ef254a847589f363f133403f9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(288811d1-b7ed-4dac-9840-83cc8caaa15e),volume_type_id=288811d1-b7ed-4dac-9840-83cc8caaa15e)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0355cae6-2989-450b-af06-b0d5b4bdfc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0355cae6-2989-450b-af06-b0d5b4bdfc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a166c741-d305-487c-b492-5e4b7c1ae647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a166c741-d305-487c-b492-5e4b7c1ae647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb5a7f0-5ccb-44be-b2e2-86ba0da36725', 'volume_name': 'volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4510c1f-562c-4449-8f7a-fbb8218c744a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4510c1f-562c-4449-8f7a-fbb8218c744a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3def44f-6705-44b1-9ba4-45e0c621017a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:50 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Volume fdb5a7f0-5ccb-44be-b2e2-86ba0da36725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725', 'volume_size': 1}
Apr 24 14:43:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-2a18882f-27c3-4d49-b660-edde35fcbdcf-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-2a18882f-27c3-4d49-b660-edde35fcbdcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-quobyte-2a18882f-27c3-4d49-b660-edde35fcbdcf" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-2a18882f-27c3-4d49-b660-edde35fcbdcf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Deleting offline snapshot 2a18882f-27c3-4d49-b660-edde35fcbdcf of volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] snapshot_file for this snap is: volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a93e558-c633-4b4b-9f3e-2daf34e04bd9]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:51 devstack sudo[85150]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332 1073741824" returned: 0 in 0.885s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:51 devstack sudo[85155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf
Apr 24 14:43:51 devstack sudo[85155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:51 devstack sudo[85157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332
Apr 24 14:43:51 devstack sudo[85157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:51 devstack sudo[85157]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332" returned: 0 in 0.514s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.130s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=61f427a3-3624-4b50-a4bb-d88905668759,created_at=2026-04-24T12:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1076844346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=61f427a3-3624-4b50-a4bb-d88905668759,host='devstack@QuobyteHD#QuobyteHD',id=fdb5a7f0-5ccb-44be-b2e2-86ba0da36725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5aa2fdd11f4f7ab69c44100a421679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:43:51Z,use_quota=True,user_id='45353ef254a847589f363f133403f9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(288811d1-b7ed-4dac-9840-83cc8caaa15e),volume_type_id=288811d1-b7ed-4dac-9840-83cc8caaa15e)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Creating volume fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:43:51 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:51 devstack sudo[85155]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf" returned: 0 in 0.662s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:43:51 devstack sudo[85170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 1073741824
Apr 24 14:43:51 devstack sudo[85170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7038a9e1-8984-4e78-adaf-3200702f19f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211f6ddd-aaa5-4035-ab9a-512de291f332', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043720e0-87e8-4b78-b6eb-a0a09ab4bde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f2c1b-a75c-4ddb-8051-9fff18d94240]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:51 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Volume volume-211f6ddd-aaa5-4035-ab9a-512de291f332 (211f6ddd-aaa5-4035-ab9a-512de291f332): created successfully
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043720e0-87e8-4b78-b6eb-a0a09ab4bde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Flow 'volume_create_manager' (6dd4e43f-02c7-458a-91cc-81bbc9a2d6b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:51 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1171f815-6151-4119-b3f4-c8242e8d4718 tempest-AbsoluteLimitsTests-127542715 None] Created volume successfully.
Apr 24 14:43:52 devstack sudo[85172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:43:52 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:52 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.687s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:43:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:52 devstack sudo[85181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf
Apr 24 14:43:52 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:52 devstack sudo[85170]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 1073741824" returned: 0 in 0.802s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Acquiring lock "cinder-211f6ddd-aaa5-4035-ab9a-512de291f332-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Lock "cinder-211f6ddd-aaa5-4035-ab9a-512de291f332-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:52 devstack sudo[85183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725
Apr 24 14:43:52 devstack sudo[85183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Acquiring lock "cinder-quobyte-211f6ddd-aaa5-4035-ab9a-512de291f332" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:43:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Lock "cinder-quobyte-211f6ddd-aaa5-4035-ab9a-512de291f332" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:43:52 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2956af8d-8845-4d91-b496-eaadceda03cf]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:52 devstack sudo[85185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332
Apr 24 14:43:52 devstack sudo[85185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:53 devstack sudo[85183]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725" returned: 0 in 0.552s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3def44f-6705-44b1-9ba4-45e0c621017a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1a4970-ebb1-4521-a1ae-21f58bdf10ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:43:53 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Volume volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 (fdb5a7f0-5ccb-44be-b2e2-86ba0da36725): created successfully
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1a4970-ebb1-4521-a1ae-21f58bdf10ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Flow 'volume_create_manager' (ab9afeb8-7b75-4741-b942-38706f6b84b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:43:53 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-88311cc2-0984-4891-ab1c-2ba05d7d127c tempest-GroupSnapshotsTest-1418024490 None] Created volume successfully.
Apr 24 14:43:53 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf" returned: 0 in 0.765s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:53 devstack sudo[85185]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332" returned: 0 in 0.589s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:53 devstack sudo[85212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf
Apr 24 14:43:53 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:53 devstack sudo[85213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332
Apr 24 14:43:53 devstack sudo[85213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:53 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.2a18882f-27c3-4d49-b660-edde35fcbdcf" returned: 0 in 0.453s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-2a18882f-27c3-4d49-b660-edde35fcbdcf" released by "_delete_snapshot" :: held 2.695s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" released by "delete_snapshot" :: held 2.724s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:53 devstack sudo[85213]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-211f6ddd-aaa5-4035-ab9a-512de291f332" returned: 0 in 0.499s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Lock "cinder-quobyte-211f6ddd-aaa5-4035-ab9a-512de291f332" released by "delete_volume" :: held 1.136s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Created reservations ['f74969cc-a878-46d2-ac91-ac89909c6cd5', 'c88d3e54-dcc8-479f-8dc5-abc29034ffd1', '57f70783-0cf8-4b37-ac60-f3a975becb5b', '288462b2-45bc-4476-81d2-f6c7da1d6ea6'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:53 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Created reservations ['cc529a70-8f3b-4972-ab75-09d990da2375', 'ee216431-676c-4f85-9e36-255e79fb91ff', 'c47ad80c-cad7-42ad-8ef9-bfeff1239f1e', '53b077bb-55d5-4bfb-9dbe-a256796b749a'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:43:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Delete snapshot completed successfully.
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-29d6fe21-fd4c-4c98-a7df-96853488be6e tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-2a18882f-27c3-4d49-b660-edde35fcbdcf-delete_snapshot" released by "delete_snapshot" :: held 2.954s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:54 devstack sudo[85218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:43:54 devstack sudo[85218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] GroupSnapshot 7957a430-78a9-4f82-ae9b-4d953d01bcdd: creating.
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] Group snapshot 7957a430-78a9-4f82-ae9b-4d953d01bcdd: creating. {{(pid=81510) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] Creating offline snapshot c0d5a010-02f2-4b69-b40a-c8aa97748fa4 of volume fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d8ff97-777a-44d6-92ff-fca4ab7a06c3]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:54 devstack sudo[85220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725
Apr 24 14:43:54 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:43:54 devstack sudo[85218]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.547s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:43:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Deleted volume successfully.
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-88a98b96-420e-43f6-bfd3-79016d3f22c0 tempest-AbsoluteLimitsTests-127542715 None] Lock "cinder-211f6ddd-aaa5-4035-ab9a-512de291f332-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:43:54 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725" returned: 0 in 0.630s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:54 devstack sudo[85229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4 1G
Apr 24 14:43:54 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:55 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4 1G" returned: 0 in 0.665s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:55 devstack sudo[85241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4
Apr 24 14:43:55 devstack sudo[85241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:56 devstack sudo[85241]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4" returned: 0 in 0.670s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:56 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4 is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:43:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:56 devstack sudo[85265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4
Apr 24 14:43:56 devstack sudo[85265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:56 devstack sudo[85265]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4" returned: 0 in 0.631s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:56 devstack sudo[85284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.info
Apr 24 14:43:56 devstack sudo[85284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:57 devstack sudo[85284]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.info" returned: 0 in 0.704s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:57 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:43:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:57 devstack sudo[85288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.info
Apr 24 14:43:57 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:58 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.info" returned: 0 in 0.730s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.166s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:43:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.788s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:43:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] Creating offline snapshot e916e9ba-6791-4707-8435-f2f556debef8 of volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:43:58 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efa4833-4b22-4bb8-8feb-bee2c14916de]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:43:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:58 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-3873cd5d-de91-4d07-912c-c4a8ae208f28 tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 7957a430-78a9-4f82-ae9b-4d953d01bcdd: created successfully
Apr 24 14:43:58 devstack sudo[85291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:43:58 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:59 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root
Apr 24 14:43:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.821s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:43:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:43:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:43:59 devstack sudo[85296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8 1G
Apr 24 14:43:59 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:43:59 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 7957a430-78a9-4f82-ae9b-4d953d01bcdd: deleting
Apr 24 14:43:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 7957a430-78a9-4f82-ae9b-4d953d01bcdd: deleting {{(pid=81510) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 24 14:43:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-c0d5a010-02f2-4b69-b40a-c8aa97748fa4" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-c0d5a010-02f2-4b69-b40a-c8aa97748fa4" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Deleting offline snapshot c0d5a010-02f2-4b69-b40a-c8aa97748fa4 of volume fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] snapshot_file for this snap is: volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5579bfd-14b1-4812-86dc-c2ab226f5c4a]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:00 devstack sudo[85298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4
Apr 24 14:44:00 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:00 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8 1G" returned: 0 in 1.329s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:00 devstack sudo[85303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8
Apr 24 14:44:00 devstack sudo[85303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Flow 'volume_create_manager' (d5a88ae7-ce8f-4d58-8068-d9546da0f290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbac927-61c5-4773-9bc5-de917b33de7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbac927-61c5-4773-9bc5-de917b33de7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1191846903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f188a81-287e-41a8-a0fe-19215df94db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6482c190074da9a9cd542f6488347d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:01Z,use_quota=True,user_id='9e57f9db6d1c4b579dc43c444b88d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2c056d-c811-4be6-9acd-57597dd1a683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2c056d-c811-4be6-9acd-57597dd1a683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605ab183-b97b-41a0-a6ce-71570b53aec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605ab183-b97b-41a0-a6ce-71570b53aec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f188a81-287e-41a8-a0fe-19215df94db2', 'volume_name': 'volume-1f188a81-287e-41a8-a0fe-19215df94db2', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1011159-63f5-4f74-8bba-b865dba9fbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1011159-63f5-4f74-8bba-b865dba9fbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b2e85e-317b-4c10-8a77-4024d3a0e5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Volume 1f188a81-287e-41a8-a0fe-19215df94db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f188a81-287e-41a8-a0fe-19215df94db2', 'volume_size': 1}
Apr 24 14:44:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:01 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4" returned: 0 in 0.884s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb05aa58-0a29-4d11-a892-a7e1ff3b2413]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:01 devstack sudo[85309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725
Apr 24 14:44:01 devstack sudo[85309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:01 devstack sudo[85303]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8" returned: 0 in 0.602s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:01 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8 is being set with open permissions: ugo+rw
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:01 devstack sudo[85313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8
Apr 24 14:44:01 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:01 devstack sudo[85309]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725" returned: 0 in 0.571s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:01 devstack sudo[85319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4
Apr 24 14:44:01 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:01 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8" returned: 0 in 0.502s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.420s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1191846903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f188a81-287e-41a8-a0fe-19215df94db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6482c190074da9a9cd542f6488347d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:01Z,use_quota=True,user_id='9e57f9db6d1c4b579dc43c444b88d023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Creating volume 1f188a81-287e-41a8-a0fe-19215df94db2 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:44:01 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:44:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:01 devstack sudo[85322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2 1073741824
Apr 24 14:44:01 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:01 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1829e1fa-f22d-4d2f-b374-e1827a912735 tempest-SnapshotsActionsTest-1081268019 None] Create snapshot completed successfully
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-e916e9ba-6791-4707-8435-f2f556debef8-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-e916e9ba-6791-4707-8435-f2f556debef8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-quobyte-e916e9ba-6791-4707-8435-f2f556debef8" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-e916e9ba-6791-4707-8435-f2f556debef8" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Deleting offline snapshot e916e9ba-6791-4707-8435-f2f556debef8 of volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] snapshot_file for this snap is: volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbc27a3-60ea-44e4-8149-cbd0e471a3b5]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:02 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4" returned: 0 in 0.772s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:02 devstack sudo[85328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8
Apr 24 14:44:02 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:02 devstack sudo[85330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4
Apr 24 14:44:02 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:02 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2 1073741824" returned: 0 in 0.921s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:02 devstack sudo[85335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2
Apr 24 14:44:02 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:03 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725.c0d5a010-02f2-4b69-b40a-c8aa97748fa4" returned: 0 in 0.634s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-c0d5a010-02f2-4b69-b40a-c8aa97748fa4" released by "_delete_snapshot" :: held 3.026s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725" released by "delete_snapshot" :: held 3.084s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:03 devstack cinder-volume[81510]: WARNING cinder.quota [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1444893017 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1444893017, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:44:03 devstack cinder-volume[81510]: WARNING cinder.quota [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1444893017 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1444893017, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['db36a006-342a-465b-a5c1-16035db0e7b5', 'ea82e9ea-198a-47b8-bcf6-80083b570b0c', 'a15129ad-4d3e-4952-9dcf-452b0c5a90de', 'edaf9a3f-c11b-4e73-a01b-ade161bc663e'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:03 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1690968b-e0e2-4851-86eb-5b6d56135d19 tempest-GroupSnapshotsTest-1418024490 None] group_snapshot 7957a430-78a9-4f82-ae9b-4d953d01bcdd: deleted successfully
Apr 24 14:44:03 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8" returned: 0 in 1.024s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c33f1d1-33a0-42bc-818a-ddb2ee988d4e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:03 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2" returned: 0 in 0.607s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b2e85e-317b-4c10-8a77-4024d3a0e5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f188a81-287e-41a8-a0fe-19215df94db2', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:03 devstack sudo[85342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af02d44-ff1f-4107-83d4-509dea9eb292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:03 devstack sudo[85342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:03 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Volume volume-1f188a81-287e-41a8-a0fe-19215df94db2 (1f188a81-287e-41a8-a0fe-19215df94db2): created successfully
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af02d44-ff1f-4107-83d4-509dea9eb292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Flow 'volume_create_manager' (d5a88ae7-ce8f-4d58-8068-d9546da0f290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:03 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d925cc76-67fe-4c5c-be93-47ca874000e9 tempest-VolumesMetadataTest-1354692308 None] Created volume successfully.
Apr 24 14:44:03 devstack sudo[85342]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.642s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:44:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:04 devstack sudo[85354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8
Apr 24 14:44:04 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "cinder-quobyte-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725" acquired by "delete_volume" :: waited 0.033s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:04 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f5fd26-d164-4cd3-bf0c-e0eff8a453f5]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:04 devstack sudo[85371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725
Apr 24 14:44:04 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Acquiring lock "cinder-1f188a81-287e-41a8-a0fe-19215df94db2-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Lock "cinder-1f188a81-287e-41a8-a0fe-19215df94db2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Acquiring lock "cinder-quobyte-1f188a81-287e-41a8-a0fe-19215df94db2" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Lock "cinder-quobyte-1f188a81-287e-41a8-a0fe-19215df94db2" acquired by "delete_volume" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:05 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b560d91-0aaa-4f37-80ff-2dc1a0b8f908]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:05 devstack sudo[85377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2
Apr 24 14:44:05 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:05 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8" returned: 0 in 1.392s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:05 devstack sudo[85386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8
Apr 24 14:44:05 devstack sudo[85386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:05 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725" returned: 0 in 0.781s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:05 devstack sudo[85389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725
Apr 24 14:44:05 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:05 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2" returned: 0 in 0.728s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:05 devstack sudo[85394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2
Apr 24 14:44:05 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:06 devstack sudo[85386]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.e916e9ba-6791-4707-8435-f2f556debef8" returned: 0 in 0.659s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-e916e9ba-6791-4707-8435-f2f556debef8" released by "_delete_snapshot" :: held 3.833s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" released by "delete_snapshot" :: held 3.883s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Created reservations ['37ad0d4d-55d2-4c34-9b92-283443ab847b', 'a5e55b46-d916-4452-893c-7907814e6818', 'a0181c4a-129a-401c-81cf-0c98493dbfae', '6a4bc4d9-0b80-4706-97ac-259555d657d8'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:06 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725" returned: 0 in 0.721s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Lock "cinder-quobyte-fdb5a7f0-5ccb-44be-b2e2-86ba0da36725" released by "delete_volume" :: held 1.568s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:06 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Delete snapshot completed successfully.
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-64303585-1c0f-48ac-9a3e-e44224271a35 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-e916e9ba-6791-4707-8435-f2f556debef8-delete_snapshot" released by "delete_snapshot" :: held 4.180s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['37e8f4e1-611d-4fc9-8152-26f3c1be6a1a'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:06 devstack cinder-volume[81510]: WARNING cinder.quota [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1444893017 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1444893017, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Created reservations ['2558a40b-db0a-4504-ac25-f78eb9e5c0d5', 'f36c23c1-772f-49a2-a6d6-e7d328618231', '193f1a68-0ebb-4439-9cca-806ee13365d9', '0493f887-19dd-45d1-84b3-42b1de328d7d'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:06 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1f188a81-287e-41a8-a0fe-19215df94db2" returned: 0 in 0.645s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Lock "cinder-quobyte-1f188a81-287e-41a8-a0fe-19215df94db2" released by "delete_volume" :: held 1.466s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Created reservations ['77bfdf30-ee95-4226-89a6-b09ee28f567e', '7f1d08ea-67ca-4a8a-a406-9086a1dbaba5', '45142830-42de-4b1d-a23a-fde1e3887b82', '8236c495-527c-4699-8158-a36e1aaab2e6'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:06 devstack sudo[85399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:44:06 devstack sudo[85399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:06 devstack sudo[85401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:44:06 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] Creating offline snapshot 8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 of volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:44:07 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2190884-663c-4588-b599-ecc8ba67586c]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:07 devstack sudo[85403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:44:07 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:07 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.765s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:07 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:44:07 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Deleted volume successfully.
Apr 24 14:44:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b6c7f255-d822-492a-84b8-33e27eaa4e30 tempest-VolumesMetadataTest-1354692308 None] Lock "cinder-1f188a81-287e-41a8-a0fe-19215df94db2-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:07 devstack sudo[85399]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.997s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:07 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:44:07 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6e30e998-ebf3-4f4c-9bca-b593b9ce3a86 tempest-GroupSnapshotsTest-1418024490 None] Delete group completed successfully.
Apr 24 14:44:08 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 1.092s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:44:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:08 devstack sudo[85410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 1G
Apr 24 14:44:08 devstack sudo[85410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:09 devstack sudo[85410]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 1G" returned: 0 in 1.114s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:09 devstack sudo[85447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6
Apr 24 14:44:09 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:10 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6" returned: 0 in 0.781s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:10 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 is being set with open permissions: ugo+rw
Apr 24 14:44:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:10 devstack sudo[85452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6
Apr 24 14:44:10 devstack sudo[85452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:10 devstack sudo[85452]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6" returned: 0 in 0.637s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.791s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:10 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-0cba11a8-e842-4b90-8d0c-9405a489318b tempest-SnapshotsActionsTest-1081268019 None] Create snapshot completed successfully
Apr 24 14:44:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-8d3c7a15-08de-4528-8640-ab4a4a8d1eb6-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-8d3c7a15-08de-4528-8640-ab4a4a8d1eb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-quobyte-8d3c7a15-08de-4528-8640-ab4a4a8d1eb6" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-8d3c7a15-08de-4528-8640-ab4a4a8d1eb6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Deleting offline snapshot 8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 of volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:44:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] snapshot_file for this snap is: volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:44:11 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a5d07e-a684-48b0-b6fe-b3ad6208983f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:11 devstack sudo[85455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6
Apr 24 14:44:11 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:12 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6" returned: 0 in 0.730s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:44:12 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff067788-f691-4222-a2c3-4caf92681fb1]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:12 devstack sudo[85461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:44:12 devstack sudo[85461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:13 devstack sudo[85461]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.783s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:13 devstack sudo[85469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6
Apr 24 14:44:13 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Flow 'volume_create_manager' (2f1b0fbc-6326-4391-956c-7ede23026a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb312691-1f6d-484a-aa03-09e2e87d6973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb312691-1f6d-484a-aa03-09e2e87d6973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1022043785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebd8836-84e1-42ee-b445-278f4a863294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41fbb14933c4757ba89bec35ebf7f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:14Z,use_quota=True,user_id='17865e8a6c174431bb5b32d2990e5e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383df1d1-f289-4f54-ae84-ea785e0ccb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383df1d1-f289-4f54-ae84-ea785e0ccb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8834ea22-72f9-4ac5-bfb6-69692496fc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8834ea22-72f9-4ac5-bfb6-69692496fc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ebd8836-84e1-42ee-b445-278f4a863294', 'volume_name': 'volume-6ebd8836-84e1-42ee-b445-278f4a863294', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a1800f-3e9d-484e-8dce-8a95841572ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a1800f-3e9d-484e-8dce-8a95841572ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf3b161-b4a3-4e4b-9989-a6d6fe7b3f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:13 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Volume 6ebd8836-84e1-42ee-b445-278f4a863294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ebd8836-84e1-42ee-b445-278f4a863294', 'volume_size': 1}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1022043785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebd8836-84e1-42ee-b445-278f4a863294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41fbb14933c4757ba89bec35ebf7f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:14Z,use_quota=True,user_id='17865e8a6c174431bb5b32d2990e5e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Creating volume 6ebd8836-84e1-42ee-b445-278f4a863294 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:44:13 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:44:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:13 devstack sudo[85474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294 1073741824
Apr 24 14:44:13 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:14 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6" returned: 0 in 0.901s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:14 devstack sudo[85476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6
Apr 24 14:44:14 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:14 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.8d3c7a15-08de-4528-8640-ab4a4a8d1eb6" returned: 0 in 0.598s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-8d3c7a15-08de-4528-8640-ab4a4a8d1eb6" released by "_delete_snapshot" :: held 3.129s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" released by "delete_snapshot" :: held 3.156s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:14 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294 1073741824" returned: 0 in 0.878s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:14 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Created reservations ['f3f77605-1091-4dad-b2d5-cdc9f301301f', '0867ce7f-ed03-4f8a-b2b7-4f09aa92ab78', '2c0f1388-04da-405c-b67e-8e8c2e9ffe1a', '29feed3f-1bd3-40d8-a1df-c6fc1ddfe648'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:14 devstack sudo[85482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294
Apr 24 14:44:14 devstack sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:14 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Delete snapshot completed successfully.
Apr 24 14:44:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c0baa7ce-19bd-4153-a7aa-3bc977b4e45b tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-8d3c7a15-08de-4528-8640-ab4a4a8d1eb6-delete_snapshot" released by "delete_snapshot" :: held 3.386s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:15 devstack sudo[85482]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294" returned: 0 in 0.520s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:44:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf3b161-b4a3-4e4b-9989-a6d6fe7b3f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ebd8836-84e1-42ee-b445-278f4a863294', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b810b39-9721-4235-a90c-98d6e1e72d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:15 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Volume volume-6ebd8836-84e1-42ee-b445-278f4a863294 (6ebd8836-84e1-42ee-b445-278f4a863294): created successfully
Apr 24 14:44:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b810b39-9721-4235-a90c-98d6e1e72d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Flow 'volume_create_manager' (2f1b0fbc-6326-4391-956c-7ede23026a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:15 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-744981df-9d9f-4fff-859d-5d6487a324eb tempest-VolumesTransfersV355Test-1491143594 None] Created volume successfully.
Apr 24 14:44:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] Creating offline snapshot 713615b1-3bf8-4bd0-94ff-81911f0b689b of volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:44:16 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ccac53-9fb7-40da-8e4a-03d84f462988]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:16 devstack sudo[85485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:44:16 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:16 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-328a3e4e-1738-4bfd-b7b3-5f96ba0a4ef6 tempest-VolumesTransfersV355Test-117454011 None] Transfer volume completed successfully.
Apr 24 14:44:16 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.745s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:44:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:17 devstack sudo[85490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b 1G
Apr 24 14:44:17 devstack sudo[85490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:17 devstack sudo[85490]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b 1G" returned: 0 in 0.835s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:17 devstack sudo[85495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b
Apr 24 14:44:17 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Acquiring lock "cinder-6ebd8836-84e1-42ee-b445-278f4a863294-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Lock "cinder-6ebd8836-84e1-42ee-b445-278f4a863294-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Acquiring lock "cinder-quobyte-6ebd8836-84e1-42ee-b445-278f4a863294" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Lock "cinder-quobyte-6ebd8836-84e1-42ee-b445-278f4a863294" acquired by "delete_volume" :: waited 0.031s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:18 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e5f703-3a4b-46ea-b247-c840206afd30]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:18 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b" returned: 0 in 0.794s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:18 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b is being set with open permissions: ugo+rw
Apr 24 14:44:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:18 devstack sudo[85501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b
Apr 24 14:44:18 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:18 devstack sudo[85500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294
Apr 24 14:44:18 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:19 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b" returned: 0 in 0.740s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.248s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a371810d-fca6-49c0-b74b-1740e2c2d1b0 tempest-SnapshotsActionsTest-1081268019 None] Create snapshot completed successfully
Apr 24 14:44:19 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294" returned: 0 in 0.903s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:19 devstack sudo[85508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294
Apr 24 14:44:19 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e36fc2f8-923b-4705-a805-c10b66d72061 tempest-GroupsV320Test-1093694950 None] Group tempest-GroupsV320Test-Group-1455155395: creating
Apr 24 14:44:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e36fc2f8-923b-4705-a805-c10b66d72061 tempest-GroupsV320Test-1093694950 None] Group tempest-GroupsV320Test-Group-1455155395: created successfully
Apr 24 14:44:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e36fc2f8-923b-4705-a805-c10b66d72061 tempest-GroupsV320Test-1093694950 None] Create group completed successfully.
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Flow 'volume_create_manager' (f1d14c1d-483e-4e83-ac38-a72d51f24bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934f3424-4d7a-4767-90f8-4dcaca6edbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934f3424-4d7a-4767-90f8-4dcaca6edbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:20Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bc10b6-baf7-40f4-915b-602a16016546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c94138402824aad8a4e21ab26a5ea22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:20Z,use_quota=True,user_id='1927a960d3cb4f548fb8eeac064c8b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a6f2bc-131f-4447-a091-7c9d1ad39a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a6f2bc-131f-4447-a091-7c9d1ad39a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53009d53-ed4b-430a-bc54-9064163e777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.image.glance [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Creating Keystone auth plugin from conf {{(pid=81510) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 14:44:20 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6ebd8836-84e1-42ee-b445-278f4a863294" returned: 0 in 0.716s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Lock "cinder-quobyte-6ebd8836-84e1-42ee-b445-278f4a863294" released by "delete_volume" :: held 1.675s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Created reservations ['53f111f8-93e9-4cdc-8e3f-79bd14a66f71', 'ae32726d-77c5-4595-975e-370a43108cee', 'c141a173-c149-49ab-aacb-80d0e5b809cf', 'b5750bd7-05b0-45b2-8371-af85f86f2905'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:20 devstack sudo[85512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:44:20 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53009d53-ed4b-430a-bc54-9064163e777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3bc10b6-baf7-40f4-915b-602a16016546', 'volume_name': 'volume-b3bc10b6-baf7-40f4-915b-602a16016546', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed77200a0>}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f02bda9-a4ee-4a38-85e9-2a35fd247550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f02bda9-a4ee-4a38-85e9-2a35fd247550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57de945-66cd-4094-b741-30041a0fca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:20 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Volume b3bc10b6-baf7-40f4-915b-602a16016546: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3bc10b6-baf7-40f4-915b-602a16016546', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed77200a0>}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Trying to clone b3bc10b6-baf7-40f4-915b-602a16016546 from image 30506e97-0d47-4b1b-9d4d-f76757b4246f at location (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]). {{(pid=81510) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-713615b1-3bf8-4bd0-94ff-81911f0b689b-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-713615b1-3bf8-4bd0-94ff-81911f0b689b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Acquiring lock "cinder-quobyte-713615b1-3bf8-4bd0-94ff-81911f0b689b" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-713615b1-3bf8-4bd0-94ff-81911f0b689b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Deleting offline snapshot 713615b1-3bf8-4bd0-94ff-81911f0b689b of volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] snapshot_file for this snap is: volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01cc5c9-5c97-40a7-8629-e493c53dc896]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:20 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.496s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:44:20 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Deleted volume successfully.
Apr 24 14:44:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9940bdd2-d4ef-47fb-be34-17d4b0206db8 tempest-VolumesTransfersV355Test-598922610 None] Lock "cinder-6ebd8836-84e1-42ee-b445-278f4a863294-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:20 devstack sudo[85535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b
Apr 24 14:44:20 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 14:44:21 devstack cinder-volume[81510]: INFO cinder.image.image_utils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fa555e-b016-42b2-9949-f723f1f957c9]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:21 devstack sudo[85538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD
Apr 24 14:44:21 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Flow 'volume_create_manager' (e586f851-e240-446c-95b8-5baa93a34f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c473d90a-6f2c-46d8-86ba-a95427c71f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c473d90a-6f2c-46d8-86ba-a95427c71f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1824703109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb86cad-61cb-46db-b3f5-7083b90ca3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41fbb14933c4757ba89bec35ebf7f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:21Z,use_quota=True,user_id='17865e8a6c174431bb5b32d2990e5e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2912d798-87e4-4777-8a28-23b0f6b56e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2912d798-87e4-4777-8a28-23b0f6b56e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbafdb20-cd79-4f28-85e1-f80f5fca01c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbafdb20-cd79-4f28-85e1-f80f5fca01c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb86cad-61cb-46db-b3f5-7083b90ca3f7', 'volume_name': 'volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd3c88f-bb4f-42c5-ae93-d04b96d9862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd3c88f-bb4f-42c5-ae93-d04b96d9862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafc359b-fc63-4150-bd0c-d1a773fc164e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:21 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Volume cbb86cad-61cb-46db-b3f5-7083b90ca3f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7', 'volume_size': 1}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1824703109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb86cad-61cb-46db-b3f5-7083b90ca3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41fbb14933c4757ba89bec35ebf7f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:21Z,use_quota=True,user_id='17865e8a6c174431bb5b32d2990e5e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Creating volume cbb86cad-61cb-46db-b3f5-7083b90ca3f7 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:44:21 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:21 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b" returned: 0 in 0.822s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:21 devstack sudo[85543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7 1073741824
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:44:21 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e49bf0c-113a-4df3-af7a-33cc36a977ab]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-afee811a-13e1-49c4-af32-c01530b7239c tempest-GroupsV320Test-1093694950 None] Created reservations ['6fee289d-aca3-47ab-886b-f5d65bb589ca'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:21 devstack sudo[85545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:44:21 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-afee811a-13e1-49c4-af32-c01530b7239c tempest-GroupsV320Test-1093694950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-afee811a-13e1-49c4-af32-c01530b7239c tempest-GroupsV320Test-1093694950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-afee811a-13e1-49c4-af32-c01530b7239c tempest-GroupsV320Test-1093694950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-afee811a-13e1-49c4-af32-c01530b7239c tempest-GroupsV320Test-1093694950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-afee811a-13e1-49c4-af32-c01530b7239c tempest-GroupsV320Test-1093694950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-afee811a-13e1-49c4-af32-c01530b7239c tempest-GroupsV320Test-1093694950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:21 devstack sudo[85579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:44:21 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:22 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD" returned: 0 in 0.915s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Temporary image 30506e97-0d47-4b1b-9d4d-f76757b4246f is fetched for user 1927a960d3cb4f548fb8eeac064c8b73. {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ae0d6e-1aa5-4bf8-8cda-6f0149ef98ad]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:22 devstack sudo[85586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD
Apr 24 14:44:22 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:22 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7 1073741824" returned: 0 in 0.929s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:22 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-afee811a-13e1-49c4-af32-c01530b7239c tempest-GroupsV320Test-1093694950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.741s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-afee811a-13e1-49c4-af32-c01530b7239c tempest-GroupsV320Test-1093694950 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:22 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-afee811a-13e1-49c4-af32-c01530b7239c tempest-GroupsV320Test-1093694950 None] Delete group completed successfully.
Apr 24 14:44:22 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.930s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:22 devstack sudo[85596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7
Apr 24 14:44:22 devstack sudo[85596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:22 devstack sudo[85597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b
Apr 24 14:44:22 devstack sudo[85597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:22 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD" returned: 0 in 0.644s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:23 devstack sudo[85596]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7" returned: 0 in 0.594s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.366s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:20Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bc10b6-baf7-40f4-915b-602a16016546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c94138402824aad8a4e21ab26a5ea22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:20Z,use_quota=True,user_id='1927a960d3cb4f548fb8eeac064c8b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Creating volume b3bc10b6-baf7-40f4-915b-602a16016546 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:44:23 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafc359b-fc63-4150-bd0c-d1a773fc164e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fd982a-bb1d-4284-8be4-1f6afa058206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:23 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Volume volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7 (cbb86cad-61cb-46db-b3f5-7083b90ca3f7): created successfully
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fd982a-bb1d-4284-8be4-1f6afa058206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:23 devstack sudo[85607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 1073741824
Apr 24 14:44:23 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Flow 'volume_create_manager' (e586f851-e240-446c-95b8-5baa93a34f43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:23 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-8228ad3a-dcb7-44a0-8367-173154bbdf5b tempest-VolumesTransfersV355Test-1491143594 None] Created volume successfully.
Apr 24 14:44:23 devstack sudo[85597]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b" returned: 0 in 0.804s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:23 devstack sudo[85609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b
Apr 24 14:44:23 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Acquiring lock "cinder-cbb86cad-61cb-46db-b3f5-7083b90ca3f7-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Lock "cinder-cbb86cad-61cb-46db-b3f5-7083b90ca3f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Acquiring lock "cinder-quobyte-cbb86cad-61cb-46db-b3f5-7083b90ca3f7" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Lock "cinder-quobyte-cbb86cad-61cb-46db-b3f5-7083b90ca3f7" acquired by "delete_volume" :: waited 0.038s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[74acd265-6364-4944-b134-a47079331a3c]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:24 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 1073741824" returned: 0 in 1.060s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:24 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.713615b1-3bf8-4bd0-94ff-81911f0b689b" returned: 0 in 0.913s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:24 devstack sudo[85615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7
Apr 24 14:44:24 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:24 devstack sudo[85616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546
Apr 24 14:44:24 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-713615b1-3bf8-4bd0-94ff-81911f0b689b" released by "_delete_snapshot" :: held 3.617s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" released by "delete_snapshot" :: held 3.642s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Created reservations ['06041db3-0500-4c15-9c72-465ecb647fc8', 'df6a7341-efe2-4b0a-9de0-08385835fc06', '37e1148c-01c4-4a01-98aa-fbef7d2d7cfa', '6d452bf3-e9e7-4647-af63-a4ea5ff554f0'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:24 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Delete snapshot completed successfully.
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f4aa081b-79d2-4383-876a-107c50020a20 tempest-SnapshotsActionsTest-1517936688 None] Lock "cinder-713615b1-3bf8-4bd0-94ff-81911f0b689b-delete_snapshot" released by "delete_snapshot" :: held 3.889s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:24 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546" returned: 0 in 0.600s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Attempting download of 30506e97-0d47-4b1b-9d4d-f76757b4246f ((None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}])) to volume b3bc10b6-baf7-40f4-915b-602a16016546. {{(pid=81510) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbfcae9-ceaa-4757-9a2b-53152aab7f3d]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_0ankqc3g {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:25 devstack sudo[85623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_0ankqc3g
Apr 24 14:44:25 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:25 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7" returned: 0 in 0.903s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:25 devstack sudo[85625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7
Apr 24 14:44:25 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "cinder-fc58cb08-519a-4722-ac80-a18acba8a849-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Lock "cinder-fc58cb08-519a-4722-ac80-a18acba8a849-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "cinder-quobyte-fc58cb08-519a-4722-ac80-a18acba8a849" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Lock "cinder-quobyte-fc58cb08-519a-4722-ac80-a18acba8a849" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Deleting offline snapshot fc58cb08-519a-4722-ac80-a18acba8a849 of volume 3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] snapshot_file for this snap is: volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b7c11e-06de-4498-9163-a3b2de6732ec]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:25 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_0ankqc3g" returned: 0 in 0.695s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_0ankqc3g {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:25 devstack sudo[85629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:44:25 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:25 devstack sudo[85631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_0ankqc3g
Apr 24 14:44:25 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:25 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cbb86cad-61cb-46db-b3f5-7083b90ca3f7" returned: 0 in 0.707s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Lock "cinder-quobyte-cbb86cad-61cb-46db-b3f5-7083b90ca3f7" released by "delete_volume" :: held 1.700s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:25 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Created reservations ['8f77816c-c88b-473d-919b-fe08467041cc', 'a8ac34a7-25a1-4347-82d0-b989a5992fb4', 'a7ce57ce-6394-4b60-9ee6-a8180031d406', '9f3ad13d-4e09-4788-a580-f63837b9a916'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:26 devstack sudo[85634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:44:26 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:26 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.753s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e827786-fd65-4706-bc82-0cd41e7eda49]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:26 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_0ankqc3g" returned: 1 in 0.750s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_0ankqc3g' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afb6cfd-5867-4355-b6e7-072c3613672b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:26 devstack sudo[85641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b
Apr 24 14:44:26 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:26 devstack sudo[85642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD
Apr 24 14:44:26 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:26 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.603s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:44:26 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Deleted volume successfully.
Apr 24 14:44:26 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ed0b585a-1986-429d-9ddf-7db70b01f077 tempest-VolumesTransfersV355Test-598922610 None] Lock "cinder-cbb86cad-61cb-46db-b3f5-7083b90ca3f7-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:27 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:27 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] 30506e97-0d47-4b1b-9d4d-f76757b4246f was qcow2, converting to raw {{(pid=81510) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 14:44:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:27 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" returned: 0 in 0.843s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:27 devstack sudo[85652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546
Apr 24 14:44:27 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:27 devstack sudo[85654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:44:27 devstack sudo[85654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:27 devstack sudo[85654]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.780s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:28 devstack sudo[85669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849
Apr 24 14:44:28 devstack sudo[85669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:28 devstack sudo[85669]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b.fc58cb08-519a-4722-ac80-a18acba8a849" returned: 0 in 0.786s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Lock "cinder-quobyte-fc58cb08-519a-4722-ac80-a18acba8a849" released by "_delete_snapshot" :: held 3.307s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" released by "delete_snapshot" :: held 3.343s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:28 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Created reservations ['88c35cf7-d1e5-48e5-a78f-6fd65361ba03', 'f4e6b39d-dd2b-4d03-85d1-328b6f85e78b', '8ee9dd66-7d55-4e8d-984b-cac070857867', '762ae5cd-aa8d-42e2-8eb8-0da6133535a2'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:29 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Delete snapshot completed successfully.
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-25c09ed5-2801-4adf-aba8-d11faf971120 tempest-SnapshotsActionsTest-1081268019 None] Lock "cinder-fc58cb08-519a-4722-ac80-a18acba8a849-delete_snapshot" released by "delete_snapshot" :: held 3.543s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:29 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546" returned: 0 in 1.948s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_b9jfbsogdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:44:29 devstack cinder-volume[81510]: INFO cinder.image.image_utils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Converted 112.00 MB image at 57.44 MB/s
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:29 devstack sudo[85672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 1G
Apr 24 14:44:29 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:29 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 1G" returned: 0 in 0.622s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "cinder-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7295ad6-566d-4b1e-9112-e782309b75f3]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Lock "cinder-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:29 devstack sudo[85677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546
Apr 24 14:44:29 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8381860d-4727-4720-aa50-14c33d553d03]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:30 devstack sudo[85679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b
Apr 24 14:44:30 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:30 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546" returned: 0 in 0.695s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:30 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" returned: 0 in 0.605s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:30 devstack sudo[85687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b
Apr 24 14:44:30 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:30 devstack sudo[85686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546
Apr 24 14:44:30 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:31 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" returned: 0 in 0.643s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Lock "cinder-quobyte-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b" released by "delete_volume" :: held 1.321s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Created reservations ['8c867288-52ca-4284-9b13-280bb2d21bc1', 'c2d82e2e-e090-4360-a7d1-4e171aaacb89', '985bff75-892a-41a4-b778-ee6d9b28debf', 'ef7097b6-1cbd-4974-9d90-fa685e41813f'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:31 devstack sudo[85694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:44:31 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:31 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546" returned: 1 in 0.889s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Downloaded image 30506e97-0d47-4b1b-9d4d-f76757b4246f ((None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}])) to volume b3bc10b6-baf7-40f4-915b-602a16016546 successfully. {{(pid=81510) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Temporary image 30506e97-0d47-4b1b-9d4d-f76757b4246f for user 1927a960d3cb4f548fb8eeac064c8b73 is deleted. {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Marking volume b3bc10b6-baf7-40f4-915b-602a16016546 as bootable. {{(pid=81510) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Copying metadata from image 30506e97-0d47-4b1b-9d4d-f76757b4246f to b3bc10b6-baf7-40f4-915b-602a16016546. {{(pid=81510) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Creating volume glance metadata for volume b3bc10b6-baf7-40f4-915b-602a16016546 backed by image 30506e97-0d47-4b1b-9d4d-f76757b4246f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81510) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57de945-66cd-4094-b741-30041a0fca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3bc10b6-baf7-40f4-915b-602a16016546', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed77200a0>}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0842bd73-632f-47a8-b9d7-af8620b1a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:31 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Volume volume-b3bc10b6-baf7-40f4-915b-602a16016546 (b3bc10b6-baf7-40f4-915b-602a16016546): created successfully
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0842bd73-632f-47a8-b9d7-af8620b1a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Flow 'volume_create_manager' (f1d14c1d-483e-4e83-ac38-a72d51f24bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:31 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-a394dfa4-77cf-4a47-990e-8c860b1c0bfb tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Created volume successfully.
Apr 24 14:44:31 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.513s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:44:31 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Deleted volume successfully.
Apr 24 14:44:31 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9c2358a-a2a3-47a5-bf19-ee4552c9c47d tempest-SnapshotsActionsTest-1081268019 None] Lock "cinder-3cf5d354-ebbb-4b6c-bf9b-b8983af8667b-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:32 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:44:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Flow 'volume_create_manager' (8a614c35-7816-4ddc-b29c-2e1228f8a19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9026a6-c01e-4119-9f13-7dcad29f0e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9026a6-c01e-4119-9f13-7dcad29f0e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1882405031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776c43dd-8e40-4df9-8407-8ec887323f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71de288d76f9469fb94a71cdd87a6911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:33Z,use_quota=True,user_id='05802b7736b74566881000ad15526b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c989b54-07ec-42aa-b698-3b0ffe2de17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c989b54-07ec-42aa-b698-3b0ffe2de17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b012af41-84bc-45fd-96fd-df24e080b677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:32 devstack cinder-volume[81510]: DEBUG cinder.image.glance [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Creating Keystone auth plugin from conf {{(pid=81510) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-d7c650ee-6fac-4f92-942b-1bf2ece2ef17 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-d7c650ee-6fac-4f92-942b-1bf2ece2ef17 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e946afc4-e809-4c93-8ff9-74c06191f1ad]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-d7c650ee-6fac-4f92-942b-1bf2ece2ef17 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:33 devstack sudo[85706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546
Apr 24 14:44:33 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b012af41-84bc-45fd-96fd-df24e080b677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '776c43dd-8e40-4df9-8407-8ec887323f30', 'volume_name': 'volume-776c43dd-8e40-4df9-8407-8ec887323f30', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed75ce1d0>}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d5a903-9355-4a2b-9d40-fd65015a87dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d5a903-9355-4a2b-9d40-fd65015a87dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aca027-dae6-48bf-867d-bfbab17031a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:33 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Volume 776c43dd-8e40-4df9-8407-8ec887323f30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-776c43dd-8e40-4df9-8407-8ec887323f30', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed75ce1d0>}
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Trying to clone 776c43dd-8e40-4df9-8407-8ec887323f30 from image 30506e97-0d47-4b1b-9d4d-f76757b4246f at location (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]). {{(pid=81510) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 14:44:33 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb7fd60-65bc-4d97-8a6b-5354e4648f24]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:34 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-d7c650ee-6fac-4f92-942b-1bf2ece2ef17 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546" returned: 0 in 0.953s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-d7c650ee-6fac-4f92-942b-1bf2ece2ef17 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:34 devstack sudo[85711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD
Apr 24 14:44:34 devstack sudo[85711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:34 devstack sudo[85712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546
Apr 24 14:44:34 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:34 devstack sudo[85711]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD" returned: 0 in 0.721s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:34 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Temporary image 30506e97-0d47-4b1b-9d4d-f76757b4246f is fetched for user 05802b7736b74566881000ad15526b8e. {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 14:44:34 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e53f15-4021-45e7-b959-b32756c1583f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:34 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-d7c650ee-6fac-4f92-942b-1bf2ece2ef17 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546" returned: 1 in 0.775s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-d7c650ee-6fac-4f92-942b-1bf2ece2ef17 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:44:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-ea29108a-16fa-48b6-9309-38a842654616 req-d7c650ee-6fac-4f92-942b-1bf2ece2ef17 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.789s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-d7c650ee-6fac-4f92-942b-1bf2ece2ef17 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d', 'name': 'volume-b3bc10b6-baf7-40f4-915b-602a16016546', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bf327ee-a1ba-471e-82aa-ef68f0d42a72', 'enforce_multipath': True} {{(pid=81510) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 24 14:44:34 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-ea29108a-16fa-48b6-9309-38a842654616 req-d7c650ee-6fac-4f92-942b-1bf2ece2ef17 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] attachment_update completed successfully.
Apr 24 14:44:34 devstack sudo[85721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD
Apr 24 14:44:34 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:35 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1882405031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776c43dd-8e40-4df9-8407-8ec887323f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71de288d76f9469fb94a71cdd87a6911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:33Z,use_quota=True,user_id='05802b7736b74566881000ad15526b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Creating volume 776c43dd-8e40-4df9-8407-8ec887323f30 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:44:35 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:44:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:35 devstack sudo[85726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 1073741824
Apr 24 14:44:35 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:36 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 1073741824" returned: 0 in 0.859s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:36 devstack sudo[85731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30
Apr 24 14:44:36 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:36 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30" returned: 0 in 0.517s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:44:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:36 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Attempting download of 30506e97-0d47-4b1b-9d4d-f76757b4246f ((None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}])) to volume 776c43dd-8e40-4df9-8407-8ec887323f30. {{(pid=81510) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 14:44:37 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[07302a81-c778-4d31-b7a2-c777814de82d]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_av3vqgic {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:37 devstack sudo[85734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_av3vqgic
Apr 24 14:44:37 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:37 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_av3vqgic" returned: 0 in 0.581s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_av3vqgic {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:37 devstack sudo[85738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_av3vqgic
Apr 24 14:44:37 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:38 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_av3vqgic" returned: 1 in 0.621s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_av3vqgic' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:44:38 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[143b2020-0128-4e16-b396-a2e5901b9100]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:38 devstack sudo[85745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD
Apr 24 14:44:38 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:38 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD" returned: 0 in 0.680s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:38 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] 30506e97-0d47-4b1b-9d4d-f76757b4246f was qcow2, converting to raw {{(pid=81510) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 14:44:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:38 devstack sudo[85750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30
Apr 24 14:44:38 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Flow 'volume_create_manager' (65a694af-0709-438a-aa7f-0a2a83731cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74057cd0-d8dd-416c-b5e2-9cc174b181b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74057cd0-d8dd-416c-b5e2-9cc174b181b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1559058357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903d5526-c066-4339-8d3e-d791db562d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4508070bbc3e4bb8958793d710bcaa3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:39Z,use_quota=True,user_id='75c8bc42dc4048d6bb9ea1016ec57a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fde6937-e5ee-4dc4-9fee-ad718314bfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fde6937-e5ee-4dc4-9fee-ad718314bfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b192d38f-25ae-40d9-9db9-4133efe0fbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b192d38f-25ae-40d9-9db9-4133efe0fbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903d5526-c066-4339-8d3e-d791db562d56', 'volume_name': 'volume-903d5526-c066-4339-8d3e-d791db562d56', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2ddc3e-0130-48a6-8181-db7969ccdd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2ddc3e-0130-48a6-8181-db7969ccdd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd87c90e-8f24-4158-b6db-ec5be021ff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:39 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Volume 903d5526-c066-4339-8d3e-d791db562d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903d5526-c066-4339-8d3e-d791db562d56', 'volume_size': 1}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1559058357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903d5526-c066-4339-8d3e-d791db562d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4508070bbc3e4bb8958793d710bcaa3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:39Z,use_quota=True,user_id='75c8bc42dc4048d6bb9ea1016ec57a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Creating volume 903d5526-c066-4339-8d3e-d791db562d56 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:44:39 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:44:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:39 devstack sudo[85753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56 1073741824
Apr 24 14:44:39 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:40 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56 1073741824" returned: 0 in 0.877s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:40 devstack sudo[85779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56
Apr 24 14:44:40 devstack sudo[85779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:40 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30" returned: 0 in 1.968s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:40 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_j8skf3mzdevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:44:40 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Converted 112.00 MB image at 56.86 MB/s
Apr 24 14:44:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:40 devstack sudo[85807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 1G
Apr 24 14:44:40 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:41 devstack sudo[85779]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56" returned: 0 in 0.763s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:44:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd87c90e-8f24-4158-b6db-ec5be021ff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903d5526-c066-4339-8d3e-d791db562d56', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25616fb0-b4a6-431b-b710-3439d784a154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:41 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Volume volume-903d5526-c066-4339-8d3e-d791db562d56 (903d5526-c066-4339-8d3e-d791db562d56): created successfully
Apr 24 14:44:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25616fb0-b4a6-431b-b710-3439d784a154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Flow 'volume_create_manager' (65a694af-0709-438a-aa7f-0a2a83731cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:41 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=149,cinder:UPDATE=157,cinder:INSERT=45,cinder:DELETE=9 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:44:41 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-717ede27-e421-4ab6-a762-28e1904222bc tempest-VolumesServicesTestJSON-359799835 None] Created volume successfully.
Apr 24 14:44:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Acquiring lock "cinder-903d5526-c066-4339-8d3e-d791db562d56-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Lock "cinder-903d5526-c066-4339-8d3e-d791db562d56-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:42 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:UPDATE=152,cinder:SELECT=144,cinder:INSERT=46,cinder:DELETE=8 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:44:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Acquiring lock "cinder-quobyte-903d5526-c066-4339-8d3e-d791db562d56" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:42 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 1G" returned: 0 in 1.204s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Lock "cinder-quobyte-903d5526-c066-4339-8d3e-d791db562d56" acquired by "delete_volume" :: waited 0.037s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:42 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[218721ce-ced1-4f25-b282-e8bc803c17f7]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:42 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc64f4e-0c52-4ab8-8bc2-473371243bfa]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:42 devstack sudo[85831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56
Apr 24 14:44:42 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:42 devstack sudo[85830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30
Apr 24 14:44:42 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:43 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30" returned: 0 in 0.874s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:43 devstack sudo[85840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30
Apr 24 14:44:43 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:43 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56" returned: 0 in 1.038s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:43 devstack sudo[85842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56
Apr 24 14:44:43 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:44 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30" returned: 1 in 1.061s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Downloaded image 30506e97-0d47-4b1b-9d4d-f76757b4246f ((None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}])) to volume 776c43dd-8e40-4df9-8407-8ec887323f30 successfully. {{(pid=81510) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Temporary image 30506e97-0d47-4b1b-9d4d-f76757b4246f for user 05802b7736b74566881000ad15526b8e is deleted. {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Marking volume 776c43dd-8e40-4df9-8407-8ec887323f30 as bootable. {{(pid=81510) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Copying metadata from image 30506e97-0d47-4b1b-9d4d-f76757b4246f to 776c43dd-8e40-4df9-8407-8ec887323f30. {{(pid=81510) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Creating volume glance metadata for volume 776c43dd-8e40-4df9-8407-8ec887323f30 backed by image 30506e97-0d47-4b1b-9d4d-f76757b4246f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81510) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 14:44:44 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-903d5526-c066-4339-8d3e-d791db562d56" returned: 0 in 1.189s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Lock "cinder-quobyte-903d5526-c066-4339-8d3e-d791db562d56" released by "delete_volume" :: held 2.335s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aca027-dae6-48bf-867d-bfbab17031a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-776c43dd-8e40-4df9-8407-8ec887323f30', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed75ce1d0>}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1f35af-2082-4e63-a4d3-4d0ea2871975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:44 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Volume volume-776c43dd-8e40-4df9-8407-8ec887323f30 (776c43dd-8e40-4df9-8407-8ec887323f30): created successfully
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1f35af-2082-4e63-a4d3-4d0ea2871975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Flow 'volume_create_manager' (8a614c35-7816-4ddc-b29c-2e1228f8a19b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:44 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-21d9770f-dad4-4dbc-a3ce-3a13755b0a59 tempest-VolumesExtendTest-425777491 None] Created volume successfully.
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Created reservations ['e7478fef-1140-4749-9447-fdb68ec004a5', '8cfb6271-73de-404e-9880-f13490c05325', '12861791-c4b5-48c4-a424-0717d8ca72c9', '8a180680-77a9-4d38-bcc4-264f177a9d1e'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:44 devstack sudo[85848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:44:44 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5941bd32-c6ed-4408-9ed2-c16dac571cf1 tempest-VolumesExtendTest-425777491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5941bd32-c6ed-4408-9ed2-c16dac571cf1 tempest-VolumesExtendTest-425777491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:45 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[535e8e34-6332-49bc-bf19-b3184d401312]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5941bd32-c6ed-4408-9ed2-c16dac571cf1 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:45 devstack sudo[85850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30
Apr 24 14:44:45 devstack sudo[85850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:46 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.738s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:46 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:44:46 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Deleted volume successfully.
Apr 24 14:44:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e715387-a14c-4015-8c9d-d99a71a732d4 tempest-VolumesServicesTestJSON-359799835 None] Lock "cinder-903d5526-c066-4339-8d3e-d791db562d56-delete_volume" released by "delete_volume" :: held 4.550s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:46 devstack sudo[85850]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5941bd32-c6ed-4408-9ed2-c16dac571cf1 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30" returned: 0 in 1.634s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5941bd32-c6ed-4408-9ed2-c16dac571cf1 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:47 devstack sudo[85855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30
Apr 24 14:44:47 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:47 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5941bd32-c6ed-4408-9ed2-c16dac571cf1 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30" returned: 1 in 0.785s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5941bd32-c6ed-4408-9ed2-c16dac571cf1 tempest-VolumesExtendTest-425777491 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:44:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5941bd32-c6ed-4408-9ed2-c16dac571cf1 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 2G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5941bd32-c6ed-4408-9ed2-c16dac571cf1 tempest-VolumesExtendTest-425777491 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 2G" returned: 0 in 0.191s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5941bd32-c6ed-4408-9ed2-c16dac571cf1 tempest-VolumesExtendTest-425777491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.677s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:48 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-5941bd32-c6ed-4408-9ed2-c16dac571cf1 tempest-VolumesExtendTest-425777491 None] Extend volume completed successfully.
Apr 24 14:44:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Acquiring lock "cinder-776c43dd-8e40-4df9-8407-8ec887323f30-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Lock "cinder-776c43dd-8e40-4df9-8407-8ec887323f30-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Acquiring lock "cinder-quobyte-776c43dd-8e40-4df9-8407-8ec887323f30" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Lock "cinder-quobyte-776c43dd-8e40-4df9-8407-8ec887323f30" acquired by "delete_volume" :: waited 0.049s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:49 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1bd8ba-ff35-4d64-abec-0ab9a4ca1774]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:49 devstack sudo[85863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30
Apr 24 14:44:49 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:50 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30" returned: 0 in 0.876s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:50 devstack sudo[85869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30
Apr 24 14:44:50 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:51 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30" returned: 1 in 0.879s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:51 devstack sudo[85884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30
Apr 24 14:44:51 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:51 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-776c43dd-8e40-4df9-8407-8ec887323f30" returned: 0 in 0.688s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Lock "cinder-quobyte-776c43dd-8e40-4df9-8407-8ec887323f30" released by "delete_volume" :: held 2.539s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Created reservations ['c2b0876e-dc32-4a93-a3b0-a374e85e2779', '83c4fccd-0fe3-4a2b-b333-399754e56334', '8f6c7166-2f83-4f76-b2ad-ab44c549d380', 'c1a6cace-e307-4c16-8b1d-07995497b73a'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:51 devstack sudo[85911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:44:51 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:52 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.513s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:52 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:44:52 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Deleted volume successfully.
Apr 24 14:44:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3554b2fa-ce28-4029-a5b8-bc909de0412a tempest-VolumesExtendTest-425777491 None] Lock "cinder-776c43dd-8e40-4df9-8407-8ec887323f30-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Flow 'volume_create_manager' (76c92d58-a254-41ba-ad10-5e2848e59374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abcf3151-ad8b-43bd-b934-438b457e2a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abcf3151-ad8b-43bd-b934-438b457e2a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1821252714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecd2e4b-7d32-4880-86f0-437ff40b5d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71de288d76f9469fb94a71cdd87a6911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:53Z,use_quota=True,user_id='05802b7736b74566881000ad15526b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b590fb26-580a-49f2-9416-90bd9195a96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b590fb26-580a-49f2-9416-90bd9195a96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16aa7dc0-6213-4bd8-b020-52cc29772ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16aa7dc0-6213-4bd8-b020-52cc29772ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ecd2e4b-7d32-4880-86f0-437ff40b5d97', 'volume_name': 'volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3bfc03-530f-42b6-8b2f-11ca0b6e6e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3bfc03-530f-42b6-8b2f-11ca0b6e6e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32eb4434-f8c6-4f04-85c9-11281b26b719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Volume 7ecd2e4b-7d32-4880-86f0-437ff40b5d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97', 'volume_size': 1}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1821252714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecd2e4b-7d32-4880-86f0-437ff40b5d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71de288d76f9469fb94a71cdd87a6911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:53Z,use_quota=True,user_id='05802b7736b74566881000ad15526b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Creating volume 7ecd2e4b-7d32-4880-86f0-437ff40b5d97 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:44:53 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:53 devstack sudo[85917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 1073741824
Apr 24 14:44:53 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Flow 'volume_create_manager' (5886c229-7e80-40ac-ad44-29f855f98b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb0457e-268f-4c8e-beff-9347aca533a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb0457e-268f-4c8e-beff-9347aca533a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-685820507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e94184b-26eb-4a87-996a-f8b3d36c994f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b63515ccfb446cb8d155b984bd37a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:53Z,use_quota=True,user_id='90b844bb6f1e438895e21d4064908376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c386ec9-58bc-4f3f-96d0-e5824adf2e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c386ec9-58bc-4f3f-96d0-e5824adf2e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8affa0-b365-402b-b2f8-d716b3232eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8affa0-b365-402b-b2f8-d716b3232eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e94184b-26eb-4a87-996a-f8b3d36c994f', 'volume_name': 'volume-1e94184b-26eb-4a87-996a-f8b3d36c994f', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9d3c6c-367a-4873-b9f5-e23a96573064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9d3c6c-367a-4873-b9f5-e23a96573064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830d4820-6fa2-4234-93f0-0b0eea549a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Volume 1e94184b-26eb-4a87-996a-f8b3d36c994f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e94184b-26eb-4a87-996a-f8b3d36c994f', 'volume_size': 1}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Flow 'volume_create_manager' (73a25e5b-6486-47ed-a359-7cab22539c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132c47d3-caf5-49ea-9fd7-61dfca5fa56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132c47d3-caf5-49ea-9fd7-61dfca5fa56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-147033029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c7afbd-8b85-4dfc-84e5-eb006abce94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aaa2d56a0114334a334d6903742c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:54Z,use_quota=True,user_id='d6e1dd4374aa4d73b53e25d088df5b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82b01e79-d0dc-4c14-92c9-24862a665936),volume_type_id=82b01e79-d0dc-4c14-92c9-24862a665936)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e61b61e-8ace-4bc9-af53-1cb3c35bba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e61b61e-8ace-4bc9-af53-1cb3c35bba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b7badc-f9c3-4b10-b429-e2db8d07d0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b7badc-f9c3-4b10-b429-e2db8d07d0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96c7afbd-8b85-4dfc-84e5-eb006abce94d', 'volume_name': 'volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c903dc7-9016-4656-8fa1-bb7c77b31700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c903dc7-9016-4656-8fa1-bb7c77b31700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b73f58-62cb-44c4-a7d6-b74dea5ce872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:53 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Volume 96c7afbd-8b85-4dfc-84e5-eb006abce94d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d', 'volume_size': 1}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:53 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 1073741824" returned: 0 in 0.745s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:54 devstack sudo[85941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97
Apr 24 14:44:54 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:54 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" returned: 0 in 0.444s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.110s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-685820507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e94184b-26eb-4a87-996a-f8b3d36c994f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b63515ccfb446cb8d155b984bd37a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:53Z,use_quota=True,user_id='90b844bb6f1e438895e21d4064908376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Creating volume 1e94184b-26eb-4a87-996a-f8b3d36c994f {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:44:54 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32eb4434-f8c6-4f04-85c9-11281b26b719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d08b030-912e-413f-bff5-75bedfb986c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:54 devstack sudo[85944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f 1073741824
Apr 24 14:44:54 devstack sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:54 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Volume volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 (7ecd2e4b-7d32-4880-86f0-437ff40b5d97): created successfully
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d08b030-912e-413f-bff5-75bedfb986c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Flow 'volume_create_manager' (76c92d58-a254-41ba-ad10-5e2848e59374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-479e1621-d943-4acb-9810-034a9d4c0410 tempest-VolumesExtendTest-425777491 None] Created volume successfully.
Apr 24 14:44:55 devstack sudo[85944]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f 1073741824" returned: 0 in 0.617s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:55 devstack sudo[85949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f
Apr 24 14:44:55 devstack sudo[85949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:55 devstack sudo[85949]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f" returned: 0 in 0.433s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.603s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-147033029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c7afbd-8b85-4dfc-84e5-eb006abce94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aaa2d56a0114334a334d6903742c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:44:54Z,use_quota=True,user_id='d6e1dd4374aa4d73b53e25d088df5b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82b01e79-d0dc-4c14-92c9-24862a665936),volume_type_id=82b01e79-d0dc-4c14-92c9-24862a665936)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Creating volume 96c7afbd-8b85-4dfc-84e5-eb006abce94d {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:44:55 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830d4820-6fa2-4234-93f0-0b0eea549a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e94184b-26eb-4a87-996a-f8b3d36c994f', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443c18d1-bd46-4420-9154-5f7e9ad86479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:55 devstack sudo[85952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d 1073741824
Apr 24 14:44:55 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:55 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Volume volume-1e94184b-26eb-4a87-996a-f8b3d36c994f (1e94184b-26eb-4a87-996a-f8b3d36c994f): created successfully
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443c18d1-bd46-4420-9154-5f7e9ad86479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Flow 'volume_create_manager' (5886c229-7e80-40ac-ad44-29f855f98b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:55 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6ac4d3e7-8230-46ed-9ee8-dad0e0a75c8a tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Created volume successfully.
Apr 24 14:44:56 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d 1073741824" returned: 0 in 0.581s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:56 devstack sudo[85957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d
Apr 24 14:44:56 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:56 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d" returned: 0 in 0.549s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.256s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b73f58-62cb-44c4-a7d6-b74dea5ce872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e578b58-82ee-4354-bae9-e17f4ae65564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] Creating offline snapshot a73e89ea-f76e-4d73-94a2-332ffedfe090 of volume 7ecd2e4b-7d32-4880-86f0-437ff40b5d97 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:44:56 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Volume volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d (96c7afbd-8b85-4dfc-84e5-eb006abce94d): created successfully
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e578b58-82ee-4354-bae9-e17f4ae65564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Flow 'volume_create_manager' (73a25e5b-6486-47ed-a359-7cab22539c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46d57ac-b99e-43db-b9cf-684200598994]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:56 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b7fa19ca-1346-4f97-9e65-aac9dc853a82 tempest-VolumeTypesAccessTest-2102142437 None] Created volume successfully.
Apr 24 14:44:56 devstack sudo[85961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97
Apr 24 14:44:56 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Acquiring lock "cinder-96c7afbd-8b85-4dfc-84e5-eb006abce94d-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Lock "cinder-96c7afbd-8b85-4dfc-84e5-eb006abce94d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Acquiring lock "cinder-quobyte-96c7afbd-8b85-4dfc-84e5-eb006abce94d" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Lock "cinder-quobyte-96c7afbd-8b85-4dfc-84e5-eb006abce94d" acquired by "delete_volume" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[62721158-9bbf-436f-9426-ce8416220db4]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:57 devstack sudo[85963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d
Apr 24 14:44:57 devstack sudo[85963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Acquiring lock "cinder-1e94184b-26eb-4a87-996a-f8b3d36c994f-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Lock "cinder-1e94184b-26eb-4a87-996a-f8b3d36c994f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Acquiring lock "cinder-quobyte-1e94184b-26eb-4a87-996a-f8b3d36c994f" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Lock "cinder-quobyte-1e94184b-26eb-4a87-996a-f8b3d36c994f" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da57844-e7af-42d9-9dcd-26258369d93b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:57 devstack sudo[85965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f
Apr 24 14:44:57 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:57 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" returned: 0 in 0.753s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:57 devstack sudo[85972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 1G
Apr 24 14:44:57 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:57 devstack sudo[85963]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d" returned: 0 in 0.628s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:57 devstack sudo[85975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d
Apr 24 14:44:57 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:57 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f" returned: 0 in 0.564s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:57 devstack sudo[85981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f
Apr 24 14:44:57 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:58 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-96c7afbd-8b85-4dfc-84e5-eb006abce94d" returned: 0 in 0.492s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Lock "cinder-quobyte-96c7afbd-8b85-4dfc-84e5-eb006abce94d" released by "delete_volume" :: held 1.167s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:58 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 1G" returned: 0 in 0.666s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:58 devstack sudo[85989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090
Apr 24 14:44:58 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:58 devstack cinder-volume[81510]: WARNING cinder.quota [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1445886971 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1445886971, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:44:58 devstack cinder-volume[81510]: WARNING cinder.quota [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1445886971 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1445886971, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Created reservations ['d3775e6f-57b3-4e7e-90e7-6f3db572a265', 'b71aa917-5f4c-4ae1-9437-866ca443c36c', '91f84b34-23f2-42ec-b30e-43ddf4053671', '1db547cf-7456-4b1f-91b9-d3a87c80ca39'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:58 devstack sudo[85995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:44:58 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:58 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1e94184b-26eb-4a87-996a-f8b3d36c994f" returned: 0 in 0.541s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Lock "cinder-quobyte-1e94184b-26eb-4a87-996a-f8b3d36c994f" released by "delete_volume" :: held 1.145s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Created reservations ['61106e0f-5512-4dc7-8022-db67c4122a2a', '90553aa9-f080-4aec-a2f9-81ea1c27d274', '6dae7f16-647c-451b-b67e-5d7ea1dea568', '0057497c-2061-43c0-b0f2-326bbc78c241'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:58 devstack sudo[85999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:44:58 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:58 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090" returned: 0 in 0.523s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:58 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 is being set with open permissions: ugo+rw
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:58 devstack sudo[86006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090
Apr 24 14:44:58 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:44:58 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.556s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:58 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:44:58 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Deleted volume successfully.
Apr 24 14:44:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-97c45413-010b-43e2-b780-5fe068b12dbd tempest-VolumeTypesAccessTest-2102142437 None] Lock "cinder-96c7afbd-8b85-4dfc-84e5-eb006abce94d-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:59 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.628s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:59 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:44:59 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Deleted volume successfully.
Apr 24 14:44:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d887001a-6147-451c-98f1-07cf59af23e5 tempest-VolumeQuotasNegativeTestJSON-2120390525 None] Lock "cinder-1e94184b-26eb-4a87-996a-f8b3d36c994f-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:44:59 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root
Apr 24 14:44:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090" returned: 0 in 0.602s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:44:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:44:59 devstack sudo[86030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.info
Apr 24 14:44:59 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:00 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.info" returned: 0 in 1.171s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:00 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.info is being set with open permissions: ugo+rw
Apr 24 14:45:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:00 devstack sudo[86051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.info
Apr 24 14:45:00 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:01 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.info" returned: 0 in 0.625s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.502s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:01 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2489310f-12da-41e3-a964-1c51149ee0b0 tempest-VolumesExtendTest-425777491 None] Create snapshot completed successfully
Apr 24 14:45:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d05d05ce-df81-49fa-9a2e-58294590446e tempest-VolumesExtendTest-425777491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d05d05ce-df81-49fa-9a2e-58294590446e tempest-VolumesExtendTest-425777491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:02 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[41684db1-cbb8-482b-a407-33659f404254]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d05d05ce-df81-49fa-9a2e-58294590446e tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:02 devstack sudo[86056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97
Apr 24 14:45:02 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:03 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d05d05ce-df81-49fa-9a2e-58294590446e tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" returned: 0 in 1.174s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d05d05ce-df81-49fa-9a2e-58294590446e tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 2G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d05d05ce-df81-49fa-9a2e-58294590446e tempest-VolumesExtendTest-425777491 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 2G" returned: 0 in 0.183s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d05d05ce-df81-49fa-9a2e-58294590446e tempest-VolumesExtendTest-425777491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.422s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:03 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d05d05ce-df81-49fa-9a2e-58294590446e tempest-VolumesExtendTest-425777491 None] Extend volume completed successfully.
Apr 24 14:45:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Acquiring lock "cinder-a73e89ea-f76e-4d73-94a2-332ffedfe090-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Lock "cinder-a73e89ea-f76e-4d73-94a2-332ffedfe090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Acquiring lock "cinder-quobyte-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Lock "cinder-quobyte-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" acquired by "delete_snapshot" :: waited 0.055s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Acquiring lock "cinder-quobyte-a73e89ea-f76e-4d73-94a2-332ffedfe090" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Lock "cinder-quobyte-a73e89ea-f76e-4d73-94a2-332ffedfe090" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Deleting offline snapshot a73e89ea-f76e-4d73-94a2-332ffedfe090 of volume 7ecd2e4b-7d32-4880-86f0-437ff40b5d97 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:45:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] snapshot_file for this snap is: volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:45:04 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbb0f49-0155-4560-8d9d-fd4435dbe1c0]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:05 devstack sudo[86064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090
Apr 24 14:45:05 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:05 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090" returned: 0 in 0.876s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:05 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e640ca-23ff-4ea3-b90c-3103c9968ffa]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:05 devstack sudo[86069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97
Apr 24 14:45:06 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:06 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" returned: 0 in 0.943s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:06 devstack sudo[86103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090
Apr 24 14:45:06 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:07 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090" returned: 0 in 0.710s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:07 devstack sudo[86116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090
Apr 24 14:45:07 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:08 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97.a73e89ea-f76e-4d73-94a2-332ffedfe090" returned: 0 in 0.671s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Flow 'volume_create_manager' (dfc54142-e026-46cd-b9ff-1b523b39af3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702dbd2b-b55b-4333-a215-9fbebb81015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702dbd2b-b55b-4333-a215-9fbebb81015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1412441019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbcdac33-af15-4fc7-ac2c-f3faba92a38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ccfc295894678996c4af5f5b504e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:08Z,use_quota=True,user_id='2775ed73ad884679a5f9663d85c10c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe48589-518d-43ea-b68f-81a73b511a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe48589-518d-43ea-b68f-81a73b511a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcfb78c-6160-43b5-934f-6584863bbb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcfb78c-6160-43b5-934f-6584863bbb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbcdac33-af15-4fc7-ac2c-f3faba92a38d', 'volume_name': 'volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe5235a-7ffc-4f90-b5fa-dc7b6d1c9b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe5235a-7ffc-4f90-b5fa-dc7b6d1c9b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1a2c09-25de-4013-861e-8dfc0e39e398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:08 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Volume bbcdac33-af15-4fc7-ac2c-f3faba92a38d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d', 'volume_size': 1}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1412441019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbcdac33-af15-4fc7-ac2c-f3faba92a38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ccfc295894678996c4af5f5b504e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:08Z,use_quota=True,user_id='2775ed73ad884679a5f9663d85c10c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Creating volume bbcdac33-af15-4fc7-ac2c-f3faba92a38d {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:45:08 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Lock "cinder-quobyte-a73e89ea-f76e-4d73-94a2-332ffedfe090" released by "_delete_snapshot" :: held 3.527s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Lock "cinder-quobyte-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" released by "delete_snapshot" :: held 3.568s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:08 devstack sudo[86127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d 1073741824
Apr 24 14:45:08 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Created reservations ['3b3b2b32-8aee-44fd-83e2-7434f1246ad6', 'ec7f34d1-2fa5-4028-9b84-103789e46ac8', '470af1da-7546-4e48-be05-253f2428d09e', 'c87ee338-e940-416c-925c-088b591c09ab'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:08 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Delete snapshot completed successfully.
Apr 24 14:45:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9362051c-e3f1-4f74-b478-30a7d57766e8 tempest-VolumesExtendTest-425777491 None] Lock "cinder-a73e89ea-f76e-4d73-94a2-332ffedfe090-delete_snapshot" released by "delete_snapshot" :: held 3.735s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Acquiring lock "cinder-7ecd2e4b-7d32-4880-86f0-437ff40b5d97-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Lock "cinder-7ecd2e4b-7d32-4880-86f0-437ff40b5d97-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:09 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d 1073741824" returned: 0 in 1.112s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Acquiring lock "cinder-quobyte-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Lock "cinder-quobyte-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" acquired by "delete_volume" :: waited 0.045s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:09 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[42573c9a-7840-4a9c-a53b-cd8bdc216c72]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:09 devstack sudo[86159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d
Apr 24 14:45:09 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:09 devstack sudo[86160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97
Apr 24 14:45:09 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:10 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d" returned: 0 in 0.716s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:45:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1a2c09-25de-4013-861e-8dfc0e39e398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c37eb5-55b8-4ba7-bc82-0cd1c6986fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:10 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Volume volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d (bbcdac33-af15-4fc7-ac2c-f3faba92a38d): created successfully
Apr 24 14:45:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c37eb5-55b8-4ba7-bc82-0cd1c6986fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Flow 'volume_create_manager' (dfc54142-e026-46cd-b9ff-1b523b39af3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:10 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a2efa62e-7a40-4790-8636-2d30210c8e11 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Created volume successfully.
Apr 24 14:45:10 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" returned: 0 in 1.185s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:10 devstack sudo[86168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97
Apr 24 14:45:10 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:11 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" returned: 0 in 0.579s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Lock "cinder-quobyte-7ecd2e4b-7d32-4880-86f0-437ff40b5d97" released by "delete_volume" :: held 1.893s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Created reservations ['77abb49b-0298-4486-b53f-78613a52f803', '7f53f90c-02be-4ad6-a18f-e0b1f093d15d', '9b4e1442-4810-41ca-b0f5-872aadbd7c70', 'fd37771b-61db-4e9e-ae9d-e8c940179f65'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:11 devstack sudo[86186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:45:11 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Creating offline snapshot e81cc1e4-d4e1-4186-ad95-cb8d584c754d of volume bbcdac33-af15-4fc7-ac2c-f3faba92a38d {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[330fb416-5e5a-4a4c-a572-5e4f0dc7e3db]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:12 devstack sudo[86188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d
Apr 24 14:45:12 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:12 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.089s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:12 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:45:12 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Deleted volume successfully.
Apr 24 14:45:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c623258-323b-4267-be53-d48a660bb814 tempest-VolumesExtendTest-425777491 None] Lock "cinder-7ecd2e4b-7d32-4880-86f0-437ff40b5d97-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:12 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d" returned: 0 in 0.845s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:12 devstack sudo[86220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d 1G
Apr 24 14:45:12 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:13 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d 1G" returned: 0 in 0.932s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:13 devstack sudo[86227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d
Apr 24 14:45:13 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:14 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d" returned: 0 in 0.735s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:14 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d is being set with open permissions: ugo+rw
Apr 24 14:45:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:14 devstack sudo[86233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d
Apr 24 14:45:14 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:15 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d" returned: 0 in 0.555s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:15 devstack sudo[86236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.info
Apr 24 14:45:15 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:15 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-f4992e1d-7015-43d2-960a-bb3cf5c20621 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Terminate volume connection completed successfully.
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-f4992e1d-7015-43d2-960a-bb3cf5c20621 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Deleting attachment 9bf327ee-a1ba-471e-82aa-ef68f0d42a72. {{(pid=81510) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Flow 'volume_create_manager' (02be4a15-3d2f-4f06-b119-b841c3ac535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b22cf91-d292-4a6f-a68d-810efbd5ecf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b22cf91-d292-4a6f-a68d-810efbd5ecf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-782688542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effd4fa8-5fce-494e-950e-e0a0eb06cfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24c89154da44403a8609bfb2abc5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:15Z,use_quota=True,user_id='ad5da99c5b264347841c91e96b9bbea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72c6f6c-f406-45af-a2f3-584193811e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72c6f6c-f406-45af-a2f3-584193811e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95fb6a9-60f8-4c6e-8eb5-086bab947605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.image.glance [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Creating Keystone auth plugin from conf {{(pid=81510) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 14:45:15 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.info" returned: 0 in 0.492s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:15 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.info is being set with open permissions: ugo+rw
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:15 devstack sudo[86239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.info
Apr 24 14:45:15 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95fb6a9-60f8-4c6e-8eb5-086bab947605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'effd4fa8-5fce-494e-950e-e0a0eb06cfa2', 'volume_name': 'volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed7594d90>}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fdcf47-93f2-41a7-a933-d6de7f8910da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fdcf47-93f2-41a7-a933-d6de7f8910da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db08bcd-92ab-4085-887b-4d968610dbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:15 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Volume effd4fa8-5fce-494e-950e-e0a0eb06cfa2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed7594d90>}
Apr 24 14:45:15 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Trying to clone effd4fa8-5fce-494e-950e-e0a0eb06cfa2 from image 30506e97-0d47-4b1b-9d4d-f76757b4246f at location (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]). {{(pid=81510) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 14:45:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "cinder-b3bc10b6-baf7-40f4-915b-602a16016546-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "cinder-b3bc10b6-baf7-40f4-915b-602a16016546-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:16 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.info" returned: 0 in 0.696s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.401s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "cinder-quobyte-b3bc10b6-baf7-40f4-915b-602a16016546" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:16 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1831b0a4-56d3-47fe-aa28-29731f6caff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Create snapshot completed successfully
Apr 24 14:45:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "cinder-quobyte-b3bc10b6-baf7-40f4-915b-602a16016546" acquired by "delete_volume" :: waited 0.038s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:16 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 14:45:16 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 14:45:16 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53613f5-0b4a-4e64-bb51-30f2d37f499a]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:16 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55cbe91-76ec-4784-84ad-a87bd241c5b4]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:16 devstack sudo[86243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546
Apr 24 14:45:16 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:16 devstack sudo[86244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD
Apr 24 14:45:16 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:17 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546" returned: 0 in 0.633s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:17 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD" returned: 0 in 0.670s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Temporary image 30506e97-0d47-4b1b-9d4d-f76757b4246f is fetched for user ad5da99c5b264347841c91e96b9bbea7. {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 14:45:17 devstack sudo[86252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546
Apr 24 14:45:17 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17c0687-655b-4a5b-986e-371a725de067]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:17 devstack sudo[86254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD
Apr 24 14:45:17 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Acquiring lock "cinder-e81cc1e4-d4e1-4186-ad95-cb8d584c754d-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "cinder-e81cc1e4-d4e1-4186-ad95-cb8d584c754d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Acquiring lock "cinder-quobyte-bbcdac33-af15-4fc7-ac2c-f3faba92a38d" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "cinder-quobyte-bbcdac33-af15-4fc7-ac2c-f3faba92a38d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Acquiring lock "cinder-quobyte-e81cc1e4-d4e1-4186-ad95-cb8d584c754d" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "cinder-quobyte-e81cc1e4-d4e1-4186-ad95-cb8d584c754d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Deleting offline snapshot e81cc1e4-d4e1-4186-ad95-cb8d584c754d of volume bbcdac33-af15-4fc7-ac2c-f3faba92a38d {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] snapshot_file for this snap is: volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b55a92f-9fc4-4089-a35a-861a412f8ec8]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:17 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546" returned: 1 in 0.712s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:17 devstack sudo[86263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546
Apr 24 14:45:17 devstack sudo[86259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d
Apr 24 14:45:17 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:17 devstack sudo[86263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:17 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD" returned: 0 in 0.681s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-782688542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effd4fa8-5fce-494e-950e-e0a0eb06cfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24c89154da44403a8609bfb2abc5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:15Z,use_quota=True,user_id='ad5da99c5b264347841c91e96b9bbea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Creating volume effd4fa8-5fce-494e-950e-e0a0eb06cfa2 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:45:17 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:45:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:17 devstack sudo[86266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 1073741824
Apr 24 14:45:17 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:18 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d" returned: 0 in 0.635s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5d20ef-ae0e-4608-a931-e56b6885db64]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:18 devstack sudo[86263]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b3bc10b6-baf7-40f4-915b-602a16016546" returned: 0 in 0.659s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "cinder-quobyte-b3bc10b6-baf7-40f4-915b-602a16016546" released by "delete_volume" :: held 2.090s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:18 devstack sudo[86272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d
Apr 24 14:45:18 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Flow 'volume_create_manager' (d0d0cf2a-780f-4f2b-af0d-e0558c121523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0d092d-0ae4-4833-aefd-e476a126e98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0d092d-0ae4-4833-aefd-e476a126e98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-482434893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93f5a01-f974-485a-b589-ffc25ac3bb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54f1b731b1044459028bad7d2f30f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:18Z,use_quota=True,user_id='a74a2d0120224e53b661ede71db66f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c3a0e8-901e-4d17-9dbf-03e154438e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c3a0e8-901e-4d17-9dbf-03e154438e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6eed279-16f0-464a-82a5-52124fef6251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6eed279-16f0-464a-82a5-52124fef6251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93f5a01-f974-485a-b589-ffc25ac3bb35', 'volume_name': 'volume-e93f5a01-f974-485a-b589-ffc25ac3bb35', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f45e67-bc69-4744-890b-de65ccca4e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f45e67-bc69-4744-890b-de65ccca4e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741d8442-f8a1-4f5c-a26e-c210ecd87703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:18 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Volume e93f5a01-f974-485a-b589-ffc25ac3bb35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93f5a01-f974-485a-b589-ffc25ac3bb35', 'volume_size': 1}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.quota [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Created reservations ['880e1581-7042-48aa-96ce-682154140bda', '468dd49f-f12a-4a0a-95f5-f3f732a9694d', '330670b2-d909-4002-879f-0d9864e6a924', 'e1cb5410-94ee-4463-90e9-b6679df3345c'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:18 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 1073741824" returned: 0 in 0.845s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:18 devstack sudo[86277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:45:18 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:18 devstack sudo[86279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2
Apr 24 14:45:18 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:19 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d" returned: 0 in 0.625s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:19 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d
Apr 24 14:45:19 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:19 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2" returned: 0 in 0.456s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:19 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.572s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-482434893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93f5a01-f974-485a-b589-ffc25ac3bb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54f1b731b1044459028bad7d2f30f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:18Z,use_quota=True,user_id='a74a2d0120224e53b661ede71db66f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Creating volume e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:45:19 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.531s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG cinder.manager [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:45:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Deleted volume successfully.
Apr 24 14:45:19 devstack sudo[86288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 1073741824
Apr 24 14:45:19 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Attempting download of 30506e97-0d47-4b1b-9d4d-f76757b4246f ((None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}])) to volume effd4fa8-5fce-494e-950e-e0a0eb06cfa2. {{(pid=81510) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-abd48bf7-2f39-466d-bd1d-d12d9f75ee8c req-9220c4e4-9308-4f94-b075-2eef6f09c63c tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "cinder-b3bc10b6-baf7-40f4-915b-602a16016546-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[809eff39-26bc-4a2c-89d3-7fb5777db6a4]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_f_x4olgr {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:19 devstack sudo[86290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_f_x4olgr
Apr 24 14:45:19 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:19 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d" returned: 0 in 0.661s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:19 devstack sudo[86295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d
Apr 24 14:45:19 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:20 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_f_x4olgr" returned: 0 in 0.677s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_f_x4olgr {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:20 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 1073741824" returned: 0 in 0.825s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:20 devstack sudo[86303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35
Apr 24 14:45:20 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:20 devstack sudo[86302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_f_x4olgr
Apr 24 14:45:20 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:20 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d.e81cc1e4-d4e1-4186-ad95-cb8d584c754d" returned: 0 in 0.562s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "cinder-quobyte-e81cc1e4-d4e1-4186-ad95-cb8d584c754d" released by "_delete_snapshot" :: held 2.618s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "cinder-quobyte-bbcdac33-af15-4fc7-ac2c-f3faba92a38d" released by "delete_snapshot" :: held 2.638s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Created reservations ['7d43e243-71a2-4c02-919e-ad8b39a049b1', '52121187-a851-4972-9590-7b4e346332b6', '7a518275-ed37-432e-a5b0-b7c590c70cac', '0935f511-1c22-4630-a45b-754998cd8c1a'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:20 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Delete snapshot completed successfully.
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-83d59715-dc09-4ebb-9653-326e10c02d87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "cinder-e81cc1e4-d4e1-4186-ad95-cb8d584c754d-delete_snapshot" released by "delete_snapshot" :: held 2.777s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:20 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_f_x4olgr" returned: 1 in 0.563s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_f_x4olgr' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:45:20 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b34233-4b19-4ed0-9edd-c699201e5f64]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35" returned: 0 in 0.505s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741d8442-f8a1-4f5c-a26e-c210ecd87703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93f5a01-f974-485a-b589-ffc25ac3bb35', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff07ce0-955d-49dc-af72-6d2d310007dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:20 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Volume volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 (e93f5a01-f974-485a-b589-ffc25ac3bb35): created successfully
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff07ce0-955d-49dc-af72-6d2d310007dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Flow 'volume_create_manager' (d0d0cf2a-780f-4f2b-af0d-e0558c121523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:20 devstack sudo[86310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD
Apr 24 14:45:20 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:20 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d008e59b-8b5f-4348-b50b-a8d1b4aa5b8a tempest-VolumesSnapshotListTestJSON-1555757930 None] Created volume successfully.
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Acquiring lock "cinder-bbcdac33-af15-4fc7-ac2c-f3faba92a38d-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "cinder-bbcdac33-af15-4fc7-ac2c-f3faba92a38d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Acquiring lock "cinder-quobyte-bbcdac33-af15-4fc7-ac2c-f3faba92a38d" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "cinder-quobyte-bbcdac33-af15-4fc7-ac2c-f3faba92a38d" acquired by "delete_volume" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:21 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ce271d-a34f-431c-b9c5-e410a78f43f1]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:21 devstack sudo[86318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d
Apr 24 14:45:21 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:21 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:21 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] 30506e97-0d47-4b1b-9d4d-f76757b4246f was qcow2, converting to raw {{(pid=81510) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 14:45:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:21 devstack sudo[86327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2
Apr 24 14:45:21 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:21 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d" returned: 0 in 0.639s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:21 devstack sudo[86346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d
Apr 24 14:45:21 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] Creating offline snapshot 83481e4d-caa9-49d9-95f8-8053c2f3cc28 of volume e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d2291f-19f9-45c3-86fd-63279c32cb73]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:22 devstack sudo[86355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35
Apr 24 14:45:22 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:22 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bbcdac33-af15-4fc7-ac2c-f3faba92a38d" returned: 0 in 0.604s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "cinder-quobyte-bbcdac33-af15-4fc7-ac2c-f3faba92a38d" released by "delete_volume" :: held 1.308s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Created reservations ['31494611-1f52-4793-9fa4-1d4aaf6ef824', '681a29e5-4916-4cf2-b481-60987d08c4d9', 'd7e10a57-e7d4-4df6-92d9-76127d48ff59', '5ade6bce-a5f9-4494-a006-86ea6eab698c'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:22 devstack sudo[86393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:45:22 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:22 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35" returned: 0 in 0.743s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:22 devstack sudo[86398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 1G
Apr 24 14:45:22 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:23 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2" returned: 0 in 1.655s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:23 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_byo2pupcdevstack@QuobyteHD, size 112.00 MB, duration 1.66 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:45:23 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Converted 112.00 MB image at 67.62 MB/s
Apr 24 14:45:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:23 devstack sudo[86401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 1G
Apr 24 14:45:23 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:23 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.709s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:23 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:45:23 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Deleted volume successfully.
Apr 24 14:45:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d309ff82-29c5-4bf9-b761-36b258fa2693 tempest-VolumeSnapshotQuotasNegativeTestJSON-1812121984 None] Lock "cinder-bbcdac33-af15-4fc7-ac2c-f3faba92a38d-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:23 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 1G" returned: 0 in 0.777s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:23 devstack sudo[86410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28
Apr 24 14:45:23 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:23 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 1G" returned: 0 in 0.607s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:23 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feb0dca-5908-4acf-b499-9146a5391cc9]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:23 devstack sudo[86412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2
Apr 24 14:45:23 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:24 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28" returned: 0 in 0.542s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:24 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 is being set with open permissions: ugo+rw
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:24 devstack sudo[86417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28
Apr 24 14:45:24 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:24 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2" returned: 0 in 0.651s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:24 devstack sudo[86421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2
Apr 24 14:45:24 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:24 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28" returned: 0 in 0.600s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:24 devstack sudo[86424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.info
Apr 24 14:45:24 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:24 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2" returned: 1 in 0.582s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Downloaded image 30506e97-0d47-4b1b-9d4d-f76757b4246f ((None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}])) to volume effd4fa8-5fce-494e-950e-e0a0eb06cfa2 successfully. {{(pid=81510) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Temporary image 30506e97-0d47-4b1b-9d4d-f76757b4246f for user ad5da99c5b264347841c91e96b9bbea7 is deleted. {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Marking volume effd4fa8-5fce-494e-950e-e0a0eb06cfa2 as bootable. {{(pid=81510) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Copying metadata from image 30506e97-0d47-4b1b-9d4d-f76757b4246f to effd4fa8-5fce-494e-950e-e0a0eb06cfa2. {{(pid=81510) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 14:45:24 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Creating volume glance metadata for volume effd4fa8-5fce-494e-950e-e0a0eb06cfa2 backed by image 30506e97-0d47-4b1b-9d4d-f76757b4246f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81510) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 14:45:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db08bcd-92ab-4085-887b-4d968610dbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed7594d90>}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2413be7b-1e64-45bb-9ea5-e7ca32be21ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:25 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Volume volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 (effd4fa8-5fce-494e-950e-e0a0eb06cfa2): created successfully
Apr 24 14:45:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2413be7b-1e64-45bb-9ea5-e7ca32be21ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Flow 'volume_create_manager' (02be4a15-3d2f-4f06-b119-b841c3ac535e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:25 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-8eb866d4-ad6a-4e97-adad-792396f61a7e tempest-VolumesImageMetadata-1677467987 None] Created volume successfully.
Apr 24 14:45:25 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.info" returned: 0 in 0.626s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:25 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.info is being set with open permissions: ugo+rw
Apr 24 14:45:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:25 devstack sudo[86430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.info
Apr 24 14:45:25 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:25 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.info" returned: 0 in 0.509s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.894s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:25 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-fda7ab59-4b84-4c4c-a6d2-7fda802e3555 tempest-VolumesSnapshotListTestJSON-1555757930 None] Create snapshot completed successfully
Apr 24 14:45:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] Creating offline snapshot b4449ae2-04b6-405f-a447-3010192d7626 of volume e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:45:26 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4f3d36-9f83-4236-8a5b-1df86ccbb38f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:26 devstack sudo[86433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28
Apr 24 14:45:26 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:26 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Acquiring lock "cinder-effd4fa8-5fce-494e-950e-e0a0eb06cfa2-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:26 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Lock "cinder-effd4fa8-5fce-494e-950e-e0a0eb06cfa2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:26 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Acquiring lock "cinder-quobyte-effd4fa8-5fce-494e-950e-e0a0eb06cfa2" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:26 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Lock "cinder-quobyte-effd4fa8-5fce-494e-950e-e0a0eb06cfa2" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:26 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[77317fac-85c1-426d-af4d-2b89909b92ee]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:26 devstack sudo[86435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2
Apr 24 14:45:26 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:27 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28" returned: 0 in 0.684s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:27 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e93f5a01-f974-485a-b589-ffc25ac3bb35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:27 devstack sudo[86440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 1G
Apr 24 14:45:27 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:27 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2" returned: 0 in 0.563s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:27 devstack sudo[86444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2
Apr 24 14:45:27 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:28 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 1G" returned: 0 in 0.793s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:28 devstack sudo[86452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626
Apr 24 14:45:28 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:28 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2" returned: 1 in 0.685s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:28 devstack sudo[86454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2
Apr 24 14:45:28 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:28 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-effd4fa8-5fce-494e-950e-e0a0eb06cfa2" returned: 0 in 0.499s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:28 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626" returned: 0 in 0.585s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:28 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 is being set with open permissions: ugo+rw
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Lock "cinder-quobyte-effd4fa8-5fce-494e-950e-e0a0eb06cfa2" released by "delete_volume" :: held 1.830s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:28 devstack sudo[86460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626
Apr 24 14:45:28 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Created reservations ['5535cf20-6df2-482d-99aa-bc7246f3e112', 'a26dbabe-3bd5-4275-9d05-df6dedc9d059', '47d2d75d-bd30-49b1-8102-ed830bec6deb', '6977626b-4235-42f9-94fd-53f207351a58'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:28 devstack sudo[86462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:45:28 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:29 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626" returned: 0 in 0.843s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.030s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:29 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6d73d174-af57-4bc3-9637-193ac68554ae tempest-VolumesSnapshotListTestJSON-1555757930 None] Create snapshot completed successfully
Apr 24 14:45:29 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.950s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:29 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:45:29 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Deleted volume successfully.
Apr 24 14:45:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b61cc523-f659-499e-90fe-435c2aff175f tempest-VolumesImageMetadata-1677467987 None] Lock "cinder-effd4fa8-5fce-494e-950e-e0a0eb06cfa2-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] Creating offline snapshot 370889fa-5a30-44c9-b39e-7fcc941ecd41 of volume e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:45:30 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[14264879-009a-4fbd-99fd-134373f001c2]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:31 devstack sudo[86495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626
Apr 24 14:45:31 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:31 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626" returned: 0 in 0.747s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:31 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e93f5a01-f974-485a-b589-ffc25ac3bb35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:31 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41 1G
Apr 24 14:45:31 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:32 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41 1G" returned: 0 in 0.912s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:32 devstack sudo[86507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41
Apr 24 14:45:32 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:32 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-7361852a-b7e7-413f-899b-1d0e15369169 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Terminate volume connection completed successfully.
Apr 24 14:45:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-7361852a-b7e7-413f-899b-1d0e15369169 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Deleting attachment 98334c3b-6ae9-4743-a0b0-b6fa00c42e30. {{(pid=81510) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 24 14:45:33 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41" returned: 0 in 0.690s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:33 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41 is being set with open permissions: ugo+rw
Apr 24 14:45:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:33 devstack sudo[86512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41
Apr 24 14:45:33 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "cinder-4e54789a-7fad-4540-b3d6-1e9d6484adaf-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "cinder-4e54789a-7fad-4540-b3d6-1e9d6484adaf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "cinder-quobyte-4e54789a-7fad-4540-b3d6-1e9d6484adaf" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "cinder-quobyte-4e54789a-7fad-4540-b3d6-1e9d6484adaf" acquired by "delete_volume" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:33 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[46312191-62eb-45d1-82dd-bf4501acf11e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:33 devstack sudo[86514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf
Apr 24 14:45:33 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:34 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41" returned: 0 in 0.670s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.165s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:34 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b8c6478c-c4c2-4b95-b584-9f3b16343416 tempest-VolumesSnapshotListTestJSON-1555757930 None] Create snapshot completed successfully
Apr 24 14:45:34 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf" returned: 0 in 0.778s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:34 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf
Apr 24 14:45:34 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:34 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4e54789a-7fad-4540-b3d6-1e9d6484adaf" returned: 0 in 0.590s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "cinder-quobyte-4e54789a-7fad-4540-b3d6-1e9d6484adaf" released by "delete_volume" :: held 1.430s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.quota [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Created reservations ['97d6279f-2d4c-4fe5-882b-670c140fc5c5', '77f7f8e1-f896-43c3-8857-208796fbe907', '70841704-54b4-48a2-a335-7757dcefae8a', '4d435bfe-59dc-44fa-acaa-8bcc9e14071b'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:35 devstack sudo[86523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:45:35 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Flow 'volume_create_manager' (193354da-4737-4aff-ba0c-f8b69c9400a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fbe5c0-73d9-4733-98f0-140145277934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fbe5c0-73d9-4733-98f0-140145277934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1058642681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe2ceda-096e-440c-a54a-de4cc3fb9e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca80778ef104130bd860170886076c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:35Z,use_quota=True,user_id='22f5637090e74dd8bfcfc0b6b85a26f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdacce3c-1182-40ad-9f7d-11341a967127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdacce3c-1182-40ad-9f7d-11341a967127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125bd27a-80f4-48af-acc5-e2b2ed16da0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125bd27a-80f4-48af-acc5-e2b2ed16da0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe2ceda-096e-440c-a54a-de4cc3fb9e28', 'volume_name': 'volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc7095d-cdd3-4cd8-92c0-1da218e52450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc7095d-cdd3-4cd8-92c0-1da218e52450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d948ae30-dca5-45ed-952a-5aa595798ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:35 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Volume 9fe2ceda-096e-440c-a54a-de4cc3fb9e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28', 'volume_size': 1}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1058642681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe2ceda-096e-440c-a54a-de4cc3fb9e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca80778ef104130bd860170886076c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:35Z,use_quota=True,user_id='22f5637090e74dd8bfcfc0b6b85a26f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Creating volume 9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:45:35 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:35 devstack sudo[86525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 1073741824
Apr 24 14:45:35 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:35 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.568s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.manager [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:45:35 devstack cinder-volume[81510]: INFO cinder.volume.manager [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Deleted volume successfully.
Apr 24 14:45:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [req-d5cb5c0a-c2cb-4382-b343-e04401d7aa18 req-e4416aed-ec48-4b87-94ab-3e62efd90ca3 tempest-ServerBootFromVolumeStableRescueTest-550446980 None] Lock "cinder-4e54789a-7fad-4540-b3d6-1e9d6484adaf-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "cinder-370889fa-5a30-44c9-b39e-7fcc941ecd41-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-370889fa-5a30-44c9-b39e-7fcc941ecd41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "cinder-quobyte-370889fa-5a30-44c9-b39e-7fcc941ecd41" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-370889fa-5a30-44c9-b39e-7fcc941ecd41" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Deleting offline snapshot 370889fa-5a30-44c9-b39e-7fcc941ecd41 of volume e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] snapshot_file for this snap is: volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd6a447-6e3b-4b6d-99c4-a22b03c75ef6]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:36 devstack sudo[86531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41
Apr 24 14:45:36 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:36 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 1073741824" returned: 0 in 0.930s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:36 devstack sudo[86533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28
Apr 24 14:45:36 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:36 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41" returned: 0 in 0.675s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e93f5a01-f974-485a-b589-ffc25ac3bb35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef75947-0b16-4d83-8fed-8aab2394086f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:36 devstack sudo[86538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626
Apr 24 14:45:36 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:37 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" returned: 0 in 0.652s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d948ae30-dca5-45ed-952a-5aa595798ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165ae21d-3012-44af-89ef-0a4c526dcccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:37 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Volume volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 (9fe2ceda-096e-440c-a54a-de4cc3fb9e28): created successfully
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165ae21d-3012-44af-89ef-0a4c526dcccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Flow 'volume_create_manager' (193354da-4737-4aff-ba0c-f8b69c9400a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:37 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-0cd5c0df-2d97-4ef8-a7c4-b1a3f95178b7 tempest-VolumesDeleteCascade-30890766 None] Created volume successfully.
Apr 24 14:45:37 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626" returned: 0 in 0.559s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e93f5a01-f974-485a-b589-ffc25ac3bb35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:37 devstack sudo[86544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41
Apr 24 14:45:37 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] Creating offline snapshot 8e1e8237-96ae-4afc-9222-72337f63bff0 of volume 9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3baac6a-34d1-4053-a934-f0bf6dc6c4dc]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:38 devstack sudo[86558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28
Apr 24 14:45:38 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:38 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41" returned: 0 in 1.105s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:38 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41
Apr 24 14:45:38 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:38 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" returned: 0 in 0.972s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:38 devstack sudo[86588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 1G
Apr 24 14:45:38 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:39 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.370889fa-5a30-44c9-b39e-7fcc941ecd41" returned: 0 in 0.630s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-370889fa-5a30-44c9-b39e-7fcc941ecd41" released by "_delete_snapshot" :: held 3.094s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" released by "delete_snapshot" :: held 3.150s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:39 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Created reservations ['a2cca566-215f-4c97-bbaf-fbe5b1ab1ae2', '33969e25-ae55-4fd2-b17c-fee1c4a30b3c', '74953f91-76bb-4f32-b651-16df68a520a8', 'aacff797-b569-4029-a5ee-c3d42b1c4779'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:39 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Delete snapshot completed successfully.
Apr 24 14:45:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9f050df1-a64e-41b3-b491-5a71753b2c6d tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-370889fa-5a30-44c9-b39e-7fcc941ecd41-delete_snapshot" released by "delete_snapshot" :: held 3.350s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:39 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 1G" returned: 0 in 0.778s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:39 devstack sudo[86594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0
Apr 24 14:45:39 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:40 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0" returned: 0 in 0.576s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:40 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 is being set with open permissions: ugo+rw
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:40 devstack sudo[86600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0
Apr 24 14:45:40 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "cinder-b4449ae2-04b6-405f-a447-3010192d7626-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-b4449ae2-04b6-405f-a447-3010192d7626-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "cinder-quobyte-b4449ae2-04b6-405f-a447-3010192d7626" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-b4449ae2-04b6-405f-a447-3010192d7626" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Deleting offline snapshot b4449ae2-04b6-405f-a447-3010192d7626 of volume e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] snapshot_file for this snap is: volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[632aa916-5cc4-470d-8af4-32ee0a694f0d]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Flow 'volume_create_manager' (3d9f3927-843f-4a2d-b6f5-2008739decad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:40 devstack sudo[86602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6614265-e661-4dae-8f09-94ca34d33a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:40 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6614265-e661-4dae-8f09-94ca34d33a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2093553354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbf4d37-a024-4dee-91fd-a29073dc6c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e355ef5da74d72b3c66675836ba7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:40Z,use_quota=True,user_id='3bdc466e7abf40a4aef9c4774ed41dc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c45e564-2d69-4c64-a1c0-f37c371ddab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c45e564-2d69-4c64-a1c0-f37c371ddab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6e70c3-98e2-467a-93bc-0ddb9ee3b62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6e70c3-98e2-467a-93bc-0ddb9ee3b62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dbf4d37-a024-4dee-91fd-a29073dc6c20', 'volume_name': 'volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feeb4325-a9e7-4dc9-9e89-c8d7fb4846cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feeb4325-a9e7-4dc9-9e89-c8d7fb4846cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894471a5-b713-4427-aaf7-4336b4c1d144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:40 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Volume 3dbf4d37-a024-4dee-91fd-a29073dc6c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20', 'volume_size': 1}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:40 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0" returned: 0 in 0.549s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:40 devstack sudo[86605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.info
Apr 24 14:45:40 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:41 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626" returned: 0 in 0.606s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e93f5a01-f974-485a-b589-ffc25ac3bb35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4f1d7c-4286-4b43-8823-27c7e1391912]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:41 devstack sudo[86611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28
Apr 24 14:45:41 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:41 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.info" returned: 0 in 0.547s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:41 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.info is being set with open permissions: ugo+rw
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:41 devstack sudo[86614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.info
Apr 24 14:45:41 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:UPDATE=133,cinder:SELECT=117,cinder:INSERT=49,cinder:DELETE=13 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:45:41 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28" returned: 0 in 0.569s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e93f5a01-f974-485a-b589-ffc25ac3bb35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:41 devstack sudo[86621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626
Apr 24 14:45:41 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:41 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.info" returned: 0 in 0.498s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.017s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.219s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2093553354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbf4d37-a024-4dee-91fd-a29073dc6c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e355ef5da74d72b3c66675836ba7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:40Z,use_quota=True,user_id='3bdc466e7abf40a4aef9c4774ed41dc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Creating volume 3dbf4d37-a024-4dee-91fd-a29073dc6c20 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:45:41 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:45:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:41 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2363a677-9329-4a3a-989f-f3041c13e0d7 tempest-VolumesDeleteCascade-30890766 None] Create snapshot completed successfully
Apr 24 14:45:41 devstack sudo[86623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 1073741824
Apr 24 14:45:41 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:42 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626" returned: 0 in 0.652s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:42 devstack sudo[86632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626
Apr 24 14:45:42 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:42 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 1073741824" returned: 0 in 0.730s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:42 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=111,cinder:INSERT=35,cinder:UPDATE=121,cinder:DELETE=9 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:45:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:42 devstack sudo[86634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20
Apr 24 14:45:42 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:42 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.b4449ae2-04b6-405f-a447-3010192d7626" returned: 0 in 0.489s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-b4449ae2-04b6-405f-a447-3010192d7626" released by "_delete_snapshot" :: held 2.446s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" released by "delete_snapshot" :: held 2.469s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:42 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Created reservations ['a4d737bc-e8fc-480c-9531-ab4573aa0c98', '3ee0ffa3-2716-4d33-a7e5-0d0b942decf3', 'cb93bc09-8f99-4e7d-9e14-cbc4cc5f2b05', 'c2a77ca1-c035-49f5-877d-a78ec93bb7c4'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Delete snapshot completed successfully.
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-efe3fe14-c991-40f4-a34f-33c078dfaf89 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-b4449ae2-04b6-405f-a447-3010192d7626-delete_snapshot" released by "delete_snapshot" :: held 2.651s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:43 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20" returned: 0 in 0.514s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.991s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] Creating offline snapshot deb4138a-1794-41b5-a85b-ea89db930ba5 of volume 9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894471a5-b713-4427-aaf7-4336b4c1d144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f5d9cb-0912-4e83-8c39-d76318ae313a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[459639e0-7964-4c05-adda-789b83e63d58]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:43 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Volume volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 (3dbf4d37-a024-4dee-91fd-a29073dc6c20): created successfully
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f5d9cb-0912-4e83-8c39-d76318ae313a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Flow 'volume_create_manager' (3d9f3927-843f-4a2d-b6f5-2008739decad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d7f35df0-05ca-4552-b28c-a4b2f229d622 tempest-SnapshotMetadataTestJSON-1223620934 None] Created volume successfully.
Apr 24 14:45:43 devstack sudo[86638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0
Apr 24 14:45:43 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:43 devstack sudo[86640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:45:43 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "cinder-83481e4d-caa9-49d9-95f8-8053c2f3cc28-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-83481e4d-caa9-49d9-95f8-8053c2f3cc28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "cinder-quobyte-83481e4d-caa9-49d9-95f8-8053c2f3cc28" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-83481e4d-caa9-49d9-95f8-8053c2f3cc28" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Deleting offline snapshot 83481e4d-caa9-49d9-95f8-8053c2f3cc28 of volume e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] snapshot_file for this snap is: volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0542e0-2610-4715-8a65-2d6f242f7ca4]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:43 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0" returned: 0 in 0.572s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:43 devstack sudo[86645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28
Apr 24 14:45:43 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:43 devstack sudo[86647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 1G
Apr 24 14:45:43 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:43 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.492s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:45:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:44 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28" returned: 0 in 0.586s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e93f5a01-f974-485a-b589-ffc25ac3bb35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:44 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb29f38-9d1a-4d31-bd67-1d2f261a3214]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:44 devstack sudo[86656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35
Apr 24 14:45:44 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:44 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 1G" returned: 0 in 0.815s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:44 devstack sudo[86658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5
Apr 24 14:45:44 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:44 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35" returned: 0 in 0.621s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:45 devstack sudo[86663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28
Apr 24 14:45:45 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:45 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5" returned: 0 in 0.589s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:45 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 is being set with open permissions: ugo+rw
Apr 24 14:45:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:45 devstack sudo[86668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5
Apr 24 14:45:45 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:45 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28" returned: 0 in 0.612s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:45 devstack sudo[86674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28
Apr 24 14:45:45 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:45 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5" returned: 0 in 0.510s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.748s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] Creating offline snapshot 3712c373-8f2e-4152-a3ef-abdcdedbcebc of volume 3dbf4d37-a024-4dee-91fd-a29073dc6c20 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:45:45 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[388e87ff-ccd6-41d6-9870-42acccc53a41]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:45 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-7da10b68-35e8-4849-98b9-32a5b843efa1 tempest-VolumesDeleteCascade-30890766 None] Create snapshot completed successfully
Apr 24 14:45:45 devstack sudo[86677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20
Apr 24 14:45:45 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:46 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35.83481e4d-caa9-49d9-95f8-8053c2f3cc28" returned: 0 in 0.487s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-83481e4d-caa9-49d9-95f8-8053c2f3cc28" released by "_delete_snapshot" :: held 2.432s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" released by "delete_snapshot" :: held 2.461s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Created reservations ['9f2ed08e-e5ac-4ab1-9ea3-267e1f86645e', '39a35de6-32da-4df6-8bb4-fe34a478712f', '02003e5c-1a36-4ec8-948c-a6a844b9351e', '5c4766cc-ca1b-4516-9663-777c2ae6a162'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:46 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Delete snapshot completed successfully.
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ca4a108-1bbb-4e98-a12c-5f4eafbce89e tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-83481e4d-caa9-49d9-95f8-8053c2f3cc28-delete_snapshot" released by "delete_snapshot" :: held 2.619s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:46 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20" returned: 0 in 0.631s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-9fe2ceda-096e-440c-a54a-de4cc3fb9e28-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:46 devstack sudo[86683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc 1G
Apr 24 14:45:46 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-9fe2ceda-096e-440c-a54a-de4cc3fb9e28-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Performing cascade delete. {{(pid=81510) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-8e1e8237-96ae-4afc-9222-72337f63bff0-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-8e1e8237-96ae-4afc-9222-72337f63bff0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-quobyte-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-quobyte-8e1e8237-96ae-4afc-9222-72337f63bff0" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-8e1e8237-96ae-4afc-9222-72337f63bff0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Deleting offline snapshot 8e1e8237-96ae-4afc-9222-72337f63bff0 of volume 9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] snapshot_file for this snap is: volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bea839a-7d5b-4367-ae09-b94597fc1942]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:46 devstack sudo[86685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0
Apr 24 14:45:46 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "cinder-e93f5a01-f974-485a-b589-ffc25ac3bb35-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-e93f5a01-f974-485a-b589-ffc25ac3bb35-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" acquired by "delete_volume" :: waited 0.031s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26c4ddb-69e6-4427-b594-a3aa2afb13d0]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:47 devstack sudo[86690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35
Apr 24 14:45:47 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:47 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc 1G" returned: 0 in 0.870s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:47 devstack sudo[86695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc
Apr 24 14:45:47 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:47 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0" returned: 0 in 0.712s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59c3ab8-8f75-4d4d-b0c1-ba371ff3d7ed]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:47 devstack sudo[86697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28
Apr 24 14:45:47 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:47 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35" returned: 0 in 0.627s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:47 devstack sudo[86703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35
Apr 24 14:45:47 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:47 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc" returned: 0 in 0.707s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:47 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc is being set with open permissions: ugo+rw
Apr 24 14:45:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:48 devstack sudo[86711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc
Apr 24 14:45:48 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:48 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" returned: 0 in 0.705s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df47b85-0e93-403e-a981-95d798f5dcfb]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:48 devstack sudo[86713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5
Apr 24 14:45:48 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:48 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e93f5a01-f974-485a-b589-ffc25ac3bb35" returned: 0 in 0.625s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-quobyte-e93f5a01-f974-485a-b589-ffc25ac3bb35" released by "delete_volume" :: held 1.314s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Created reservations ['e91a4d30-d5d4-43ef-aa5a-3cbf051c6164', '3c2118fb-a041-49c7-b3e5-52c7e24c4077', '3062563f-29cc-4e97-a4c4-21f04830f532', 'b92dea4c-12ac-45bc-9e6e-4611441a8935'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:48 devstack sudo[86717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:45:48 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:48 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc" returned: 0 in 0.550s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:48 devstack sudo[86719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.info
Apr 24 14:45:48 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:48 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5" returned: 0 in 0.652s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfe5f88-81e5-42b0-9e2f-3e0969e7fc1e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:48 devstack sudo[86724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0
Apr 24 14:45:48 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:48 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.556s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:48 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:45:49 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Deleted volume successfully.
Apr 24 14:45:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-feefa43d-47a7-47b7-841c-404d4861ecd1 tempest-VolumesSnapshotListTestJSON-1555757930 None] Lock "cinder-e93f5a01-f974-485a-b589-ffc25ac3bb35-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:49 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.info" returned: 0 in 0.552s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:49 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.info is being set with open permissions: ugo+rw
Apr 24 14:45:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:49 devstack sudo[86728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.info
Apr 24 14:45:49 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:49 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0" returned: 0 in 0.601s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:49 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d32d07-0950-4959-b2e9-fdf1779c0531]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:49 devstack sudo[86733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28
Apr 24 14:45:49 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:49 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.info" returned: 0 in 0.557s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.985s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:49 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a6e166da-9aa8-4190-9ad6-f27ff7ae2b26 tempest-SnapshotMetadataTestJSON-1223620934 None] Create snapshot completed successfully
Apr 24 14:45:50 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" returned: 0 in 0.691s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:50 devstack sudo[86741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0
Apr 24 14:45:50 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:50 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0" returned: 0 in 0.726s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:50 devstack sudo[86746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0
Apr 24 14:45:50 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Acquiring lock "cinder-3712c373-8f2e-4152-a3ef-abdcdedbcebc-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "cinder-3712c373-8f2e-4152-a3ef-abdcdedbcebc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Acquiring lock "cinder-quobyte-3dbf4d37-a024-4dee-91fd-a29073dc6c20" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "cinder-quobyte-3dbf4d37-a024-4dee-91fd-a29073dc6c20" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Acquiring lock "cinder-quobyte-3712c373-8f2e-4152-a3ef-abdcdedbcebc" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "cinder-quobyte-3712c373-8f2e-4152-a3ef-abdcdedbcebc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Deleting offline snapshot 3712c373-8f2e-4152-a3ef-abdcdedbcebc of volume 3dbf4d37-a024-4dee-91fd-a29073dc6c20 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] snapshot_file for this snap is: volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb888a88-740f-4808-b59e-efe4e71fe24b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:51 devstack sudo[86748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc
Apr 24 14:45:51 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:51 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.8e1e8237-96ae-4afc-9222-72337f63bff0" returned: 0 in 0.670s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 -F qcow2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:51 devstack sudo[86751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 -F qcow2
Apr 24 14:45:51 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:51 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc" returned: 0 in 0.676s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a24d31-90fc-4ec5-ab6d-509b11382442]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:52 devstack sudo[86764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20
Apr 24 14:45:52 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:52 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 -F qcow2" returned: 0 in 0.638s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-8e1e8237-96ae-4afc-9222-72337f63bff0" released by "_delete_snapshot" :: held 5.581s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" released by "delete_snapshot" :: held 5.608s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Created reservations ['bb3e79f5-7583-4d5d-b3f6-7ffece3bfd03', '61406f8c-2d9a-4bb5-8f70-9c5313e4161a', '3f7490cc-7a3b-4cc7-aa53-4b0c64ddf374', '5722308d-8b4e-4c22-9e6c-fed4866bf0a2'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:52 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Delete snapshot completed successfully.
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-8e1e8237-96ae-4afc-9222-72337f63bff0-delete_snapshot" released by "delete_snapshot" :: held 5.835s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-deb4138a-1794-41b5-a85b-ea89db930ba5-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-deb4138a-1794-41b5-a85b-ea89db930ba5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-quobyte-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-quobyte-deb4138a-1794-41b5-a85b-ea89db930ba5" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-deb4138a-1794-41b5-a85b-ea89db930ba5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Deleting offline snapshot deb4138a-1794-41b5-a85b-ea89db930ba5 of volume 9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] snapshot_file for this snap is: volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0780f571-fe45-490b-9f6d-2ac3f5a019aa]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (82eb5824-db6f-46d9-88f9-42e7b0e5881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc9d536-2020-46ed-bf8f-254493b57ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc9d536-2020-46ed-bf8f-254493b57ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1946844960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f64c92-d386-4c49-bfa5-a5c2c7927129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:52Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dffd645-034f-4091-a0d6-70bddd57b465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dffd645-034f-4091-a0d6-70bddd57b465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14a250c-abc8-4838-bcfe-421fc49f1a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14a250c-abc8-4838-bcfe-421fc49f1a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f64c92-d386-4c49-bfa5-a5c2c7927129', 'volume_name': 'volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bead1a39-d175-4161-9b15-bbd612c30419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bead1a39-d175-4161-9b15-bbd612c30419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:52 devstack sudo[86768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5
Apr 24 14:45:52 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac04c58-2e55-43f6-a19c-fd196a90506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:52 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume e5f64c92-d386-4c49-bfa5-a5c2c7927129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129', 'volume_size': 1}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1946844960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f64c92-d386-4c49-bfa5-a5c2c7927129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:52Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Creating volume e5f64c92-d386-4c49-bfa5-a5c2c7927129 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:45:52 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:52 devstack sudo[86773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 1073741824
Apr 24 14:45:52 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:52 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20" returned: 0 in 0.689s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:52 devstack sudo[86775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc
Apr 24 14:45:52 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:53 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5" returned: 0 in 0.628s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:45:53 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[daab6e07-ca48-44fc-8a52-be10e09b88bf]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:53 devstack sudo[86783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28
Apr 24 14:45:53 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:53 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 1073741824" returned: 0 in 0.839s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:53 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc" returned: 0 in 0.823s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:53 devstack sudo[86788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc
Apr 24 14:45:53 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:53 devstack sudo[86789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129
Apr 24 14:45:53 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:53 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" returned: 0 in 0.756s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:53 devstack sudo[86795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5
Apr 24 14:45:53 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:54 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:54 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129" returned: 0 in 0.545s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20.3712c373-8f2e-4152-a3ef-abdcdedbcebc" returned: 0 in 0.585s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac04c58-2e55-43f6-a19c-fd196a90506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8001f5bf-2be1-49df-8e6e-19deab87319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "cinder-quobyte-3712c373-8f2e-4152-a3ef-abdcdedbcebc" released by "_delete_snapshot" :: held 2.976s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:54 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 (e5f64c92-d386-4c49-bfa5-a5c2c7927129): created successfully
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8001f5bf-2be1-49df-8e6e-19deab87319b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (82eb5824-db6f-46d9-88f9-42e7b0e5881a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "cinder-quobyte-3dbf4d37-a024-4dee-91fd-a29073dc6c20" released by "delete_snapshot" :: held 3.038s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-9861a11c-1766-4505-971b-aeda2fe73fab tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created volume successfully.
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Created reservations ['cf7d68f9-8133-4304-9f54-09f1aa15f116', '314aebd2-83f0-47b4-9aba-8164e20479fc', 'f44a0de3-bbf6-4147-a76b-1ba19d94ee20', '32748ceb-3327-40c9-baad-bc1d995c51ec'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Delete snapshot completed successfully.
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2fc5c743-9a24-4eb2-9012-8f368640c903 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "cinder-3712c373-8f2e-4152-a3ef-abdcdedbcebc-delete_snapshot" released by "delete_snapshot" :: held 3.228s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:54 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5" returned: 0 in 0.610s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:54 devstack sudo[86802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5
Apr 24 14:45:54 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Creating offline snapshot 3343d8ab-40ee-406d-b043-9ff032767aec of volume e5f64c92-d386-4c49-bfa5-a5c2c7927129 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[11942b37-b5de-4bd5-a52e-8e696b7d4696]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:54 devstack sudo[86804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129
Apr 24 14:45:54 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:55 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28.deb4138a-1794-41b5-a85b-ea89db930ba5" returned: 0 in 0.500s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-deb4138a-1794-41b5-a85b-ea89db930ba5" released by "_delete_snapshot" :: held 2.600s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" released by "delete_snapshot" :: held 2.633s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Created reservations ['13936f0c-dcbf-4262-a6e4-e51ffff8c85e', '42205f03-998e-4307-8c4d-8a9282559a61', 'dddc040a-851d-4457-818b-8dd742359c61', '05320c72-6a40-40b4-9fd9-48c7b117db92'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:55 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Delete snapshot completed successfully.
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-deb4138a-1794-41b5-a85b-ea89db930ba5-delete_snapshot" released by "delete_snapshot" :: held 2.840s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Snapshots deleted, issuing volume delete {{(pid=81510) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-quobyte-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6912894-96ae-4c63-aab9-61e4c700fb81]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:55 devstack sudo[86807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28
Apr 24 14:45:55 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Acquiring lock "cinder-3dbf4d37-a024-4dee-91fd-a29073dc6c20-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "cinder-3dbf4d37-a024-4dee-91fd-a29073dc6c20-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Acquiring lock "cinder-quobyte-3dbf4d37-a024-4dee-91fd-a29073dc6c20" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:45:55 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129" returned: 0 in 0.823s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "cinder-quobyte-3dbf4d37-a024-4dee-91fd-a29073dc6c20" acquired by "delete_volume" :: waited 0.035s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:45:55 devstack sudo[86812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec 1G
Apr 24 14:45:55 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[359c520b-7b22-4621-970b-610a4e7ee30f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:45:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:55 devstack sudo[86814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20
Apr 24 14:45:55 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:56 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" returned: 0 in 0.678s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:56 devstack sudo[86819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28
Apr 24 14:45:56 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:56 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20" returned: 0 in 0.623s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:56 devstack sudo[86827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20
Apr 24 14:45:56 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:56 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec 1G" returned: 0 in 0.742s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:56 devstack sudo[86829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec
Apr 24 14:45:56 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:56 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" returned: 0 in 0.512s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-9fe2ceda-096e-440c-a54a-de4cc3fb9e28" released by "delete_volume" :: held 1.313s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Created reservations ['391965f0-a55e-48a6-9309-a492937a36a6', '0e1913e8-583a-4b4d-95ea-9a1177d66b49', '605270b2-a96d-48b5-86c6-ece1438ef460', '11e6e455-f1f8-46cf-831a-ef8465fb9784'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:56 devstack sudo[86832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:45:56 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:56 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-fc188a04-4c38-4ecc-a033-1ca8a06d63c8 tempest-GroupsV314Test-258987458 None] Group tempest-GroupsV314Test-Group-1128828153: creating
Apr 24 14:45:56 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-fc188a04-4c38-4ecc-a033-1ca8a06d63c8 tempest-GroupsV314Test-258987458 None] Group tempest-GroupsV314Test-Group-1128828153: created successfully
Apr 24 14:45:56 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-fc188a04-4c38-4ecc-a033-1ca8a06d63c8 tempest-GroupsV314Test-258987458 None] Create group completed successfully.
Apr 24 14:45:56 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3dbf4d37-a024-4dee-91fd-a29073dc6c20" returned: 0 in 0.587s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:56 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "cinder-quobyte-3dbf4d37-a024-4dee-91fd-a29073dc6c20" released by "delete_volume" :: held 1.273s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec" returned: 0 in 0.548s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:56 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec is being set with open permissions: ugo+rw
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:56 devstack sudo[86838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec
Apr 24 14:45:56 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:56 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Created reservations ['a4ed3b4f-52fd-47c0-8973-892e86aa417a', 'aed9b190-7be3-4dda-a9b4-7e9c8f510abe', '3a14ccf5-c587-42a0-bcff-f375e647e8af', '081f3b91-9d28-421b-b47d-72c5310260c3'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:57 devstack sudo[86840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:45:57 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:57 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.516s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:45:57 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Deleted volume successfully.
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-10790e55-f59c-40e1-af2e-cc2a7671a9c1 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-9fe2ceda-096e-440c-a54a-de4cc3fb9e28-delete_volume" released by "delete_volume" :: held 10.816s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:57 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec" returned: 0 in 0.461s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:57 devstack sudo[86845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.info
Apr 24 14:45:57 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:57 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.445s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:45:57 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Deleted volume successfully.
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9bdcac6-594f-4c04-a36c-76c238802918 tempest-SnapshotMetadataTestJSON-1223620934 None] Lock "cinder-3dbf4d37-a024-4dee-91fd-a29073dc6c20-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:45:57 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.info" returned: 0 in 0.494s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:57 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.info is being set with open permissions: ugo+rw
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Flow 'volume_create_manager' (bdfd1e33-6d80-4a35-9451-6a3afda17329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:57 devstack sudo[86848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.info
Apr 24 14:45:57 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9168db4a-8866-4035-878e-5924ca9fc9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9168db4a-8866-4035-878e-5924ca9fc9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1106587202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1d47b7-f858-45dc-83f7-387502271500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca80778ef104130bd860170886076c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:58Z,use_quota=True,user_id='22f5637090e74dd8bfcfc0b6b85a26f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3c1c2b-1f1f-4ba7-84bb-f09ed5128078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3c1c2b-1f1f-4ba7-84bb-f09ed5128078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1734e45d-0b0a-4780-8030-51d8892e135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1734e45d-0b0a-4780-8030-51d8892e135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1d47b7-f858-45dc-83f7-387502271500', 'volume_name': 'volume-cd1d47b7-f858-45dc-83f7-387502271500', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a46f537-7fd0-4003-8a03-60cc4ea457a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a46f537-7fd0-4003-8a03-60cc4ea457a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4634c721-e228-4b8d-bb3c-657169f4c4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:58 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Volume cd1d47b7-f858-45dc-83f7-387502271500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1d47b7-f858-45dc-83f7-387502271500', 'volume_size': 1}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Flow 'volume_create_manager' (c54533b9-1c25-4540-a198-e4c4a832c9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a475b3c-4ac0-4f03-a117-b6b5a93aa123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a475b3c-4ac0-4f03-a117-b6b5a93aa123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-127517700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=530000b5-30f4-4466-8f3e-4d77551d2aff,host='devstack@QuobyteHD#QuobyteHD',id=f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2858cf44e4940b587561b2c30e261de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:58Z,use_quota=True,user_id='b3fb90487c054bde9962d93281453985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e0e128d-1002-4a62-a14b-efba446e738c),volume_type_id=0e0e128d-1002-4a62-a14b-efba446e738c)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49058289-fb5e-4994-87a1-9862c685ae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49058289-fb5e-4994-87a1-9862c685ae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9262aa5-c67e-4c9e-b5d6-cf07c73e8be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9262aa5-c67e-4c9e-b5d6-cf07c73e8be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4', 'volume_name': 'volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97dbbbcc-a9fb-49a9-bb7d-e90d4c7659bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97dbbbcc-a9fb-49a9-bb7d-e90d4c7659bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de99c13-1ec2-457a-92ad-e5b675bdc223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:58 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Volume f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4', 'volume_size': 1}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:58 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.info" returned: 0 in 0.616s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.776s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.526s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1106587202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1d47b7-f858-45dc-83f7-387502271500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca80778ef104130bd860170886076c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:58Z,use_quota=True,user_id='22f5637090e74dd8bfcfc0b6b85a26f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Creating volume cd1d47b7-f858-45dc-83f7-387502271500 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:45:58 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:45:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:58 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d3a43d2c-e301-4ffb-adf9-c9ba80077e84 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Create snapshot completed successfully
Apr 24 14:45:58 devstack sudo[86851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 1073741824
Apr 24 14:45:58 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (a2ff7f8a-c851-4704-8fab-48c4d7c40ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:59 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fb4b32-dc0c-4307-a960-9784dc59d44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 1073741824" returned: 0 in 0.879s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fb4b32-dc0c-4307-a960-9784dc59d44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-128034488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bbdf83-18fd-4491-a6e3-014001b366f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:59Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac82433a-ac1a-4de7-95d2-4e246cf05e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac82433a-ac1a-4de7-95d2-4e246cf05e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6cb607a-0288-48f3-b6dc-fb842e93b5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6cb607a-0288-48f3-b6dc-fb842e93b5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75bbdf83-18fd-4491-a6e3-014001b366f1', 'volume_name': 'volume-75bbdf83-18fd-4491-a6e3-014001b366f1', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a323b06a-2347-498a-9839-01676a8d4345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a323b06a-2347-498a-9839-01676a8d4345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b2f0e0-64ed-4c4d-a287-b7eee391a020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:59 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume 75bbdf83-18fd-4491-a6e3-014001b366f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75bbdf83-18fd-4491-a6e3-014001b366f1', 'volume_size': 1}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:45:59 devstack sudo[86856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500
Apr 24 14:45:59 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (1a003558-731c-4602-8837-d51adaec630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3cd6af-ad43-48cb-8d48-d3f5ec7b495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3cd6af-ad43-48cb-8d48-d3f5ec7b495c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1428372624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da0abc1-7090-4dd0-8273-0d30390cd20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:00Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8335578-b77d-4ede-9c7b-05b161c1b881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8335578-b77d-4ede-9c7b-05b161c1b881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c362e86d-93be-4a89-8885-1f3f9b57812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c362e86d-93be-4a89-8885-1f3f9b57812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da0abc1-7090-4dd0-8273-0d30390cd20d', 'volume_name': 'volume-0da0abc1-7090-4dd0-8273-0d30390cd20d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dc7f8e-3935-4395-ac10-e7f1098e63e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dc7f8e-3935-4395-ac10-e7f1098e63e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1af064-32da-4b83-8aff-645629e0ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:45:59 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume 0da0abc1-7090-4dd0-8273-0d30390cd20d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da0abc1-7090-4dd0-8273-0d30390cd20d', 'volume_size': 1}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:45:59 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (d57f38d7-3a49-4741-86a4-2922443be857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c805799-370c-4031-b7ab-9a1fe54dff17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c805799-370c-4031-b7ab-9a1fe54dff17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-628558650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24464f4f-3422-4026-9bc8-2b929d23821c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:00Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a34d84e-a658-43d5-ae85-e091cc81be17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a34d84e-a658-43d5-ae85-e091cc81be17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d66eb1e-8ca1-4ca9-8693-ff37e0c91116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d66eb1e-8ca1-4ca9-8693-ff37e0c91116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24464f4f-3422-4026-9bc8-2b929d23821c', 'volume_name': 'volume-24464f4f-3422-4026-9bc8-2b929d23821c', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1845ef-3671-430e-a45f-56f47b25b4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1845ef-3671-430e-a45f-56f47b25b4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea96c4d8-3a8d-48cc-bac3-f559a7f6024a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume 24464f4f-3422-4026-9bc8-2b929d23821c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24464f4f-3422-4026-9bc8-2b929d23821c', 'volume_size': 1}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:00 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500" returned: 0 in 0.574s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.782s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=530000b5-30f4-4466-8f3e-4d77551d2aff,created_at=2026-04-24T12:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-127517700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=530000b5-30f4-4466-8f3e-4d77551d2aff,host='devstack@QuobyteHD#QuobyteHD',id=f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2858cf44e4940b587561b2c30e261de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:58Z,use_quota=True,user_id='b3fb90487c054bde9962d93281453985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e0e128d-1002-4a62-a14b-efba446e738c),volume_type_id=0e0e128d-1002-4a62-a14b-efba446e738c)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Creating volume f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:00 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4634c721-e228-4b8d-bb3c-657169f4c4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1d47b7-f858-45dc-83f7-387502271500', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd4735c-2be5-4234-9163-31280d90744e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack sudo[86859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 1073741824
Apr 24 14:46:00 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Volume volume-cd1d47b7-f858-45dc-83f7-387502271500 (cd1d47b7-f858-45dc-83f7-387502271500): created successfully
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd4735c-2be5-4234-9163-31280d90744e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Flow 'volume_create_manager' (bdfd1e33-6d80-4a35-9451-6a3afda17329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:00 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4ce486a5-612d-4cb0-904a-61a666d362d8 tempest-VolumesDeleteCascade-30890766 None] Created volume successfully.
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (6f3433ce-a0e8-470d-8436-0fd785059355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d32fa4-6812-4217-8a91-0b8e255d86a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d32fa4-6812-4217-8a91-0b8e255d86a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-128123656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8bde94-ab22-4273-9f14-9705c80b6e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:00Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2a158e-8819-4156-b8f9-ca098a9fb642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2a158e-8819-4156-b8f9-ca098a9fb642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6d4578-9bf8-480e-91e7-d67b4ab65fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6d4578-9bf8-480e-91e7-d67b4ab65fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a8bde94-ab22-4273-9f14-9705c80b6e6e', 'volume_name': 'volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c011460-16fe-4941-9ed0-be85700d759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c011460-16fe-4941-9ed0-be85700d759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67585d72-372f-4c7a-9e9e-5893c00b0247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume 6a8bde94-ab22-4273-9f14-9705c80b6e6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e', 'volume_size': 1}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (c4f210db-b01e-4e76-96cd-92beeda3b7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55ccfdc-894f-411a-911c-7cb0f217f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55ccfdc-894f-411a-911c-7cb0f217f987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1606198417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271ddb10-86d1-495a-9d1e-1d7114577702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:01Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffba0a6-712a-47c8-aecc-151de656ee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffba0a6-712a-47c8-aecc-151de656ee74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de69d1f-f6f0-4c68-b0e2-a5a7116ef668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de69d1f-f6f0-4c68-b0e2-a5a7116ef668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271ddb10-86d1-495a-9d1e-1d7114577702', 'volume_name': 'volume-271ddb10-86d1-495a-9d1e-1d7114577702', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6077109-83c1-44cc-ad8e-72673e69b2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6077109-83c1-44cc-ad8e-72673e69b2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce263ddc-33e1-415a-a42d-645ac17af88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume 271ddb10-86d1-495a-9d1e-1d7114577702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271ddb10-86d1-495a-9d1e-1d7114577702', 'volume_size': 1}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Flow 'volume_create_manager' (8e4261e6-1ac1-4835-bde3-d3d4ef75b809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc868a0a-a68c-4f87-929d-7ca229c7a2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc868a0a-a68c-4f87-929d-7ca229c7a2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-182350976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d719fc-3bf0-4614-9a05-35a8e2d376e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c66a46faa9604f67b7c96dc9598aeeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:01Z,use_quota=True,user_id='a22b3a7c0d9b4ecc9b15bfb83ed3c0f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27f4596-7e2a-4b0e-8579-8abdc1ecaf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27f4596-7e2a-4b0e-8579-8abdc1ecaf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddeede8-bdac-49b3-ad9e-263bf66608a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddeede8-bdac-49b3-ad9e-263bf66608a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d719fc-3bf0-4614-9a05-35a8e2d376e3', 'volume_name': 'volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed1627a-a838-4993-bd79-d046392fa68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed1627a-a838-4993-bd79-d046392fa68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63dc1044-fa41-43d3-959f-08db13523e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Volume e3d719fc-3bf0-4614-9a05-35a8e2d376e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3', 'volume_size': 1}
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:00 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 1073741824" returned: 0 in 0.851s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:01 devstack sudo[86864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4
Apr 24 14:46:01 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:01 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4" returned: 0 in 0.465s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.968s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-128034488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bbdf83-18fd-4491-a6e3-014001b366f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:45:59Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Creating volume 75bbdf83-18fd-4491-a6e3-014001b366f1 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:01 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:01 devstack sudo[86868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1 1073741824
Apr 24 14:46:01 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de99c13-1ec2-457a-92ad-e5b675bdc223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d19937-a612-44f0-b52d-bc89713fb1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:01 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Volume volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 (f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4): created successfully
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d19937-a612-44f0-b52d-bc89713fb1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Flow 'volume_create_manager' (c54533b9-1c25-4540-a198-e4c4a832c9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:01 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-01af3fd3-66f9-4793-8e81-810ddfe7fa41 tempest-GroupsV314Test-258987458 None] Created volume successfully.
Apr 24 14:46:02 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1 1073741824" returned: 0 in 0.666s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:02 devstack sudo[86874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1
Apr 24 14:46:02 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:02 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1" returned: 0 in 0.463s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.882s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1428372624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da0abc1-7090-4dd0-8273-0d30390cd20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:00Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Creating volume 0da0abc1-7090-4dd0-8273-0d30390cd20d {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:02 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b2f0e0-64ed-4c4d-a287-b7eee391a020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75bbdf83-18fd-4491-a6e3-014001b366f1', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2508ea4-456a-4026-8060-e601182c6fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:02 devstack sudo[86877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d 1073741824
Apr 24 14:46:02 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:02 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume volume-75bbdf83-18fd-4491-a6e3-014001b366f1 (75bbdf83-18fd-4491-a6e3-014001b366f1): created successfully
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2508ea4-456a-4026-8060-e601182c6fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (a2ff7f8a-c851-4704-8fab-48c4d7c40ea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:02 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4f6f4560-7cee-4c1c-82ae-d0ff95030652 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created volume successfully.
Apr 24 14:46:03 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d 1073741824" returned: 0 in 0.725s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:03 devstack sudo[86882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d
Apr 24 14:46:03 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:03 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d" returned: 0 in 0.424s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.757s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-628558650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24464f4f-3422-4026-9bc8-2b929d23821c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:00Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Creating volume 24464f4f-3422-4026-9bc8-2b929d23821c {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:03 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1af064-32da-4b83-8aff-645629e0ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da0abc1-7090-4dd0-8273-0d30390cd20d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:03 devstack sudo[86885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c 1073741824
Apr 24 14:46:03 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e9bfed-ab06-40f3-8cf5-dd6c27d20773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:03 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume volume-0da0abc1-7090-4dd0-8273-0d30390cd20d (0da0abc1-7090-4dd0-8273-0d30390cd20d): created successfully
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e9bfed-ab06-40f3-8cf5-dd6c27d20773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (1a003558-731c-4602-8837-d51adaec630d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:03 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6ab2f65f-c090-4c55-ab77-cc17b3191861 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created volume successfully.
Apr 24 14:46:04 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c 1073741824" returned: 0 in 0.646s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:04 devstack sudo[86890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c
Apr 24 14:46:04 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:04 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c" returned: 0 in 0.424s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.508s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-128123656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8bde94-ab22-4273-9f14-9705c80b6e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:00Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Creating volume 6a8bde94-ab22-4273-9f14-9705c80b6e6e {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:04 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea96c4d8-3a8d-48cc-bac3-f559a7f6024a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24464f4f-3422-4026-9bc8-2b929d23821c', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:04 devstack sudo[86893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e 1073741824
Apr 24 14:46:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2b3daa-d6fe-4c6a-9ccd-1668ef842b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:04 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:05 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume volume-24464f4f-3422-4026-9bc8-2b929d23821c (24464f4f-3422-4026-9bc8-2b929d23821c): created successfully
Apr 24 14:46:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2b3daa-d6fe-4c6a-9ccd-1668ef842b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (d57f38d7-3a49-4741-86a4-2922443be857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:05 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-52388a0c-f6a3-4dee-b97b-455311915bfe tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created volume successfully.
Apr 24 14:46:05 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e 1073741824" returned: 0 in 0.637s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:05 devstack sudo[86898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e
Apr 24 14:46:05 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:06 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e" returned: 0 in 0.438s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.349s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1606198417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271ddb10-86d1-495a-9d1e-1d7114577702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53c4f9835b402fb6943be0469f5347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:01Z,use_quota=True,user_id='643b4ac7acd7471f85167d849f55a8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Creating volume 271ddb10-86d1-495a-9d1e-1d7114577702 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:06 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67585d72-372f-4c7a-9e9e-5893c00b0247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:06 devstack sudo[86901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702 1073741824
Apr 24 14:46:06 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360d4dce-663c-4590-a984-8edc040b334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:06 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e (6a8bde94-ab22-4273-9f14-9705c80b6e6e): created successfully
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360d4dce-663c-4590-a984-8edc040b334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (6f3433ce-a0e8-470d-8436-0fd785059355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:06 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-5441f9b0-a6a2-4a67-916c-e74468bf3974 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created volume successfully.
Apr 24 14:46:06 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702 1073741824" returned: 0 in 0.603s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:06 devstack sudo[86906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702
Apr 24 14:46:06 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:07 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702" returned: 0 in 0.451s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.299s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-182350976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d719fc-3bf0-4614-9a05-35a8e2d376e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c66a46faa9604f67b7c96dc9598aeeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:01Z,use_quota=True,user_id='a22b3a7c0d9b4ecc9b15bfb83ed3c0f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Creating volume e3d719fc-3bf0-4614-9a05-35a8e2d376e3 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:07 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce263ddc-33e1-415a-a42d-645ac17af88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271ddb10-86d1-495a-9d1e-1d7114577702', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52650d67-618e-4489-bc30-549dc454fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:07 devstack sudo[86909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3 1073741824
Apr 24 14:46:07 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:07 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Volume volume-271ddb10-86d1-495a-9d1e-1d7114577702 (271ddb10-86d1-495a-9d1e-1d7114577702): created successfully
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52650d67-618e-4489-bc30-549dc454fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Flow 'volume_create_manager' (c4f210db-b01e-4e76-96cd-92beeda3b7f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:07 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f2c9399e-6cb7-4bc3-b8d4-143f3e63fc97 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created volume successfully.
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-271ddb10-86d1-495a-9d1e-1d7114577702-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-271ddb10-86d1-495a-9d1e-1d7114577702-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-quobyte-271ddb10-86d1-495a-9d1e-1d7114577702" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-271ddb10-86d1-495a-9d1e-1d7114577702" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a33b14-b840-475d-9649-7c79a48b2a15]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:07 devstack sudo[86911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702
Apr 24 14:46:07 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:07 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3 1073741824" returned: 0 in 0.626s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:07 devstack sudo[86916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3
Apr 24 14:46:07 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:08 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702" returned: 0 in 0.564s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:08 devstack sudo[86921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702
Apr 24 14:46:08 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:08 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3" returned: 0 in 0.481s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.041s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63dc1044-fa41-43d3-959f-08db13523e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2289b274-5c73-47b8-8d51-365b620c451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] Creating offline snapshot a64508ed-a3e7-43f6-abd4-e46ca53857e6 of volume cd1d47b7-f858-45dc-83f7-387502271500 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:46:08 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Volume volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3 (e3d719fc-3bf0-4614-9a05-35a8e2d376e3): created successfully
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2289b274-5c73-47b8-8d51-365b620c451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Flow 'volume_create_manager' (8e4261e6-1ac1-4835-bde3-d3d4ef75b809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca16848-c9a3-487f-9594-28a2ea889270]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:08 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b5c29d63-e8a2-4663-88e6-25ea93c3d708 tempest-VolumesListTestJSON-465617620 None] Created volume successfully.
Apr 24 14:46:08 devstack sudo[86924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500
Apr 24 14:46:08 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:08 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-271ddb10-86d1-495a-9d1e-1d7114577702" returned: 0 in 0.488s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-271ddb10-86d1-495a-9d1e-1d7114577702" released by "delete_volume" :: held 1.093s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created reservations ['7ef2a664-e5fe-46ee-addd-243226575db2', '99c5de1d-f66e-4e23-a416-2bb35f91eaa3', 'fc1fd604-7e8a-49bc-8ab9-68df2388de75', '8058aa1d-5b5e-40ba-a4fb-ad14148cfddc'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:08 devstack sudo[86927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:08 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:08 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500" returned: 0 in 0.559s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:08 devstack sudo[86932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6 1G
Apr 24 14:46:08 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:09 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.426s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:09 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Deleted volume successfully.
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cf265e3b-903c-4153-ab5a-515ad167e084 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-271ddb10-86d1-495a-9d1e-1d7114577702-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:09 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6 1G" returned: 0 in 0.609s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1d47b7-f858-45dc-83f7-387502271500 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:09 devstack sudo[86938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1d47b7-f858-45dc-83f7-387502271500 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6
Apr 24 14:46:09 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-6a8bde94-ab22-4273-9f14-9705c80b6e6e-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-6a8bde94-ab22-4273-9f14-9705c80b6e6e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Flow 'volume_create_manager' (ddff1bb5-3e3c-4d62-a0e8-cc4696b75699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed37bb7-2b60-436e-9c0f-f97d817d6bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-quobyte-6a8bde94-ab22-4273-9f14-9705c80b6e6e" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed37bb7-2b60-436e-9c0f-f97d817d6bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1473371136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344b0d3f-6269-4fad-93f3-c5677d33b648,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c66a46faa9604f67b7c96dc9598aeeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:10Z,use_quota=True,user_id='a22b3a7c0d9b4ecc9b15bfb83ed3c0f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329184a2-1576-4476-9601-c41943d959b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329184a2-1576-4476-9601-c41943d959b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8b89c0-0551-4806-b972-4a1f3ee59d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8b89c0-0551-4806-b972-4a1f3ee59d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344b0d3f-6269-4fad-93f3-c5677d33b648', 'volume_name': 'volume-344b0d3f-6269-4fad-93f3-c5677d33b648', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7e1f0c-d701-42cc-ac96-d30d5bd86e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7e1f0c-d701-42cc-ac96-d30d5bd86e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2295f0e7-4697-479f-b8fd-33ff59a8ad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:09 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Volume 344b0d3f-6269-4fad-93f3-c5677d33b648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344b0d3f-6269-4fad-93f3-c5677d33b648', 'volume_size': 1}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-6a8bde94-ab22-4273-9f14-9705c80b6e6e" acquired by "delete_volume" :: waited 0.055s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[822d4342-e35c-4eca-863e-48840cf7b3c4]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:09 devstack sudo[86940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e
Apr 24 14:46:09 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:10 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1d47b7-f858-45dc-83f7-387502271500 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6" returned: 0 in 0.528s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:10 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6 is being set with open permissions: ugo+rw
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:10 devstack sudo[86945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6
Apr 24 14:46:10 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:10 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e" returned: 0 in 0.531s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:10 devstack sudo[86950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e
Apr 24 14:46:10 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:10 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6" returned: 0 in 0.437s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:10 devstack sudo[86953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.info
Apr 24 14:46:10 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:10 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6a8bde94-ab22-4273-9f14-9705c80b6e6e" returned: 0 in 0.426s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-6a8bde94-ab22-4273-9f14-9705c80b6e6e" released by "delete_volume" :: held 0.999s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created reservations ['3d749891-a9d5-4cee-81c1-be6574407f16', '115f84c4-1495-4d21-aa34-4255d3d30514', '234dcbd3-21da-48b7-8c67-4add22222967', '2b4ce1fe-0ad8-4dd8-ad42-04145e8f3c27'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:10 devstack sudo[86957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:10 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:11 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.info" returned: 0 in 0.467s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:11 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.info is being set with open permissions: ugo+rw
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:11 devstack sudo[86959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.info
Apr 24 14:46:11 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:11 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.421s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Deleted volume successfully.
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1ce27b10-871e-4bde-be79-903ae91e37d7 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-6a8bde94-ab22-4273-9f14-9705c80b6e6e-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:11 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.info" returned: 0 in 0.443s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.158s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.838s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:11 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Cloning volume f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 to volume 609361c2-17fc-48f9-8340-a8409a3a85dc
Apr 24 14:46:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ee8895d8-c8f3-4dbf-9d3e-06174933697d tempest-VolumesDeleteCascade-30890766 None] Create snapshot completed successfully
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Creating offline snapshot 8cd567d9-5ee5-481c-8f29-bf7c616405be of volume f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae4c0be-9ac8-4fed-9d0e-d8e62360015f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:11 devstack sudo[86963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4
Apr 24 14:46:11 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-24464f4f-3422-4026-9bc8-2b929d23821c-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-24464f4f-3422-4026-9bc8-2b929d23821c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-quobyte-24464f4f-3422-4026-9bc8-2b929d23821c" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-24464f4f-3422-4026-9bc8-2b929d23821c" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[134502bd-cfc9-4f0e-b45d-f65a8218682d]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Flow 'volume_create_manager' (76de55be-48fd-4d1c-b99a-f6ed84cb2c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce57cd46-80bc-403d-9cb2-32a94afa33f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:12 devstack sudo[86967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c
Apr 24 14:46:12 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce57cd46-80bc-403d-9cb2-32a94afa33f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1817426529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42995768-0c25-472d-a2c9-74ddee6cf793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca80778ef104130bd860170886076c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a64508ed-a3e7-43f6-abd4-e46ca53857e6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:12Z,use_quota=True,user_id='22f5637090e74dd8bfcfc0b6b85a26f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159cfff0-0eef-4b24-8154-44264cb00992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159cfff0-0eef-4b24-8154-44264cb00992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:12 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35c24bf-bbf2-4c71-8b3a-779588c77f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35c24bf-bbf2-4c71-8b3a-779588c77f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '42995768-0c25-472d-a2c9-74ddee6cf793', 'volume_name': 'volume-42995768-0c25-472d-a2c9-74ddee6cf793', 'volume_size': 1, 'snapshot_id': 'a64508ed-a3e7-43f6-abd4-e46ca53857e6'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35e025b-cdb0-4ece-b9f6-d7af313adf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35e025b-cdb0-4ece-b9f6-d7af313adf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dea110d-f0a0-4442-b9a9-02e18106a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:12 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Volume 42995768-0c25-472d-a2c9-74ddee6cf793: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-42995768-0c25-472d-a2c9-74ddee6cf793', 'volume_size': 1, 'snapshot_id': 'a64508ed-a3e7-43f6-abd4-e46ca53857e6'}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4" returned: 0 in 0.632s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:12 devstack sudo[86971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be 1G
Apr 24 14:46:12 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:12 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c" returned: 0 in 0.560s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:12 devstack sudo[86979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c
Apr 24 14:46:12 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:12 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be 1G" returned: 0 in 0.582s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:12 devstack sudo[86981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be
Apr 24 14:46:12 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:13 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-24464f4f-3422-4026-9bc8-2b929d23821c" returned: 0 in 0.485s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-24464f4f-3422-4026-9bc8-2b929d23821c" released by "delete_volume" :: held 1.097s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created reservations ['932addf3-8802-4932-ba1c-e42305c44d2c', 'b82f6140-7a72-4089-a5cb-6f7aae392320', 'd55b1a89-e83b-4251-afe9-60ae09954d74', 'd444aafe-b7dc-437a-b046-8953e6740f72'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:13 devstack sudo[86987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:13 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:13 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be" returned: 0 in 0.498s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:13 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:13 devstack sudo[86989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be
Apr 24 14:46:13 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:13 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.438s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:13 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Deleted volume successfully.
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7559ad6c-4d50-409a-8769-781cb3ca4a06 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-24464f4f-3422-4026-9bc8-2b929d23821c-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:13 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be" returned: 0 in 0.445s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:13 devstack sudo[86993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.info
Apr 24 14:46:13 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-0da0abc1-7090-4dd0-8273-0d30390cd20d-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-0da0abc1-7090-4dd0-8273-0d30390cd20d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:14 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.info" returned: 0 in 0.453s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:14 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:14 devstack sudo[86996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.info
Apr 24 14:46:14 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-quobyte-0da0abc1-7090-4dd0-8273-0d30390cd20d" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-0da0abc1-7090-4dd0-8273-0d30390cd20d" acquired by "delete_volume" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[691d6e2a-0178-491b-8c4b-6f73ed9ae376]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:14 devstack sudo[86998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d
Apr 24 14:46:14 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:14 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.info" returned: 0 in 0.440s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Acquiring lock "cinder-quobyte-609361c2-17fc-48f9-8340-a8409a3a85dc" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Lock "cinder-quobyte-609361c2-17fc-48f9-8340-a8409a3a85dc" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] snapshot: 8cd567d9-5ee5-481c-8f29-bf7c616405be, volume: 609361c2-17fc-48f9-8340-a8409a3a85dc,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f754a42-7de6-469d-b6e1-0d83c113a6f4]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:14 devstack sudo[87004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be
Apr 24 14:46:14 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:14 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d" returned: 0 in 0.537s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:14 devstack sudo[87006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d
Apr 24 14:46:14 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:15 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be" returned: 0 in 0.497s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ace8b86-2ec2-43f2-922a-e23ec3441bd3]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:15 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0da0abc1-7090-4dd0-8273-0d30390cd20d" returned: 0 in 0.451s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-0da0abc1-7090-4dd0-8273-0d30390cd20d" released by "delete_volume" :: held 1.029s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:15 devstack sudo[87012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4
Apr 24 14:46:15 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created reservations ['460779cf-21ec-48a2-9fe7-5acca2aef584', '0a9da001-b07d-4ee5-b0ee-b8a1fad6f61e', 'd9f345c8-b948-49e7-b8bc-232a0c533adc', '6340d261-6986-41a7-b978-ef79872aef06'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:15 devstack sudo[87014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:15 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:15 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4" returned: 0 in 0.523s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:15 devstack sudo[87020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc
Apr 24 14:46:15 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:15 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.449s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:15 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Deleted volume successfully.
Apr 24 14:46:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-321ecbb1-ce4a-4f35-b36c-75555923227e tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-0da0abc1-7090-4dd0-8273-0d30390cd20d-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-75bbdf83-18fd-4491-a6e3-014001b366f1-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-75bbdf83-18fd-4491-a6e3-014001b366f1-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-quobyte-75bbdf83-18fd-4491-a6e3-014001b366f1" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-75bbdf83-18fd-4491-a6e3-014001b366f1" acquired by "delete_volume" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:16 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9cc676-fdb3-4b32-976a-1d89d8bd6a1e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:16 devstack sudo[87033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1
Apr 24 14:46:16 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:17 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1" returned: 0 in 1.230s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:17 devstack sudo[87038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1
Apr 24 14:46:17 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:18 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-75bbdf83-18fd-4491-a6e3-014001b366f1" returned: 0 in 0.924s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-75bbdf83-18fd-4491-a6e3-014001b366f1" released by "delete_volume" :: held 2.225s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:18 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created reservations ['1666a9a2-cba0-4467-b7e0-c8e8a5a46936', '12ab800f-f949-4207-b562-54bb318637fb', '4d78a788-e3ca-4ad8-9d61-b674a6eb8cc1', '9133e09a-b9d6-4251-8602-7ff2ba989a47'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:19 devstack sudo[87041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:19 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-3343d8ab-40ee-406d-b043-9ff032767aec-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-3343d8ab-40ee-406d-b043-9ff032767aec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-quobyte-e5f64c92-d386-4c49-bfa5-a5c2c7927129" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-e5f64c92-d386-4c49-bfa5-a5c2c7927129" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-quobyte-3343d8ab-40ee-406d-b043-9ff032767aec" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-3343d8ab-40ee-406d-b043-9ff032767aec" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Deleting offline snapshot 3343d8ab-40ee-406d-b043-9ff032767aec of volume e5f64c92-d386-4c49-bfa5-a5c2c7927129 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:46:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] snapshot_file for this snap is: volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:46:20 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ec4d15-1724-4d74-b80e-6fe4fedc52b0]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:20 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.104s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:20 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:20 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Deleted volume successfully.
Apr 24 14:46:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ada15dc5-2602-4f71-ac10-7a2222013b58 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-75bbdf83-18fd-4491-a6e3-014001b366f1-delete_volume" released by "delete_volume" :: held 3.748s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:20 devstack sudo[87045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec
Apr 24 14:46:20 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:20 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc" returned: 0 in 5.130s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:20 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4363fb-baf6-4582-a27a-436934998570]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:21 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4
Apr 24 14:46:21 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:21 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec" returned: 0 in 0.918s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:46:21 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd619cd8-2150-40d8-bf21-da332d167db0]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:21 devstack sudo[87052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129
Apr 24 14:46:21 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:21 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129" returned: 0 in 0.496s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:21 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4" returned: 0 in 0.624s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:21 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:46:21 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Converted 1024.00 MB image at 199.56 MB/s
Apr 24 14:46:21 devstack sudo[87060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec
Apr 24 14:46:21 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:21 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc is being set with open permissions: ugo+rw: NotImplementedError
Apr 24 14:46:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:21 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc
Apr 24 14:46:21 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:22 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc" returned: 0 in 0.447s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Lock "cinder-quobyte-609361c2-17fc-48f9-8340-a8409a3a85dc" released by "_copy_volume_from_snapshot" :: held 7.313s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Acquiring lock "cinder-quobyte-8cd567d9-5ee5-481c-8f29-bf7c616405be" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Lock "cinder-quobyte-8cd567d9-5ee5-481c-8f29-bf7c616405be" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:22 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Deleting offline snapshot 8cd567d9-5ee5-481c-8f29-bf7c616405be of volume f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] snapshot_file for this snap is: volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec" returned: 0 in 0.551s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6736be-fa8b-447a-9835-3a63378f59f1]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:22 devstack sudo[87068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec
Apr 24 14:46:22 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:22 devstack sudo[87069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be
Apr 24 14:46:22 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:22 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129.3343d8ab-40ee-406d-b043-9ff032767aec" returned: 0 in 0.400s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-3343d8ab-40ee-406d-b043-9ff032767aec" released by "_delete_snapshot" :: held 2.510s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-e5f64c92-d386-4c49-bfa5-a5c2c7927129" released by "delete_snapshot" :: held 2.548s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created reservations ['eabc3131-e53b-41f8-b7d4-16e93c54f725', 'b2811f82-07a7-4920-821c-a25ae4207145', '87281726-a3c3-46c2-9b40-c0a5d87e7355', 'b40b5073-227b-4dba-8f6a-30f84774a604'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:22 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Delete snapshot completed successfully.
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11227107-483e-41b1-8b78-3207bda50db2 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-3343d8ab-40ee-406d-b043-9ff032767aec-delete_snapshot" released by "delete_snapshot" :: held 2.694s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:22 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be" returned: 0 in 0.560s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a50485e-4cbf-45fa-b35c-79ced9748f34]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:22 devstack sudo[87109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4
Apr 24 14:46:22 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-e5f64c92-d386-4c49-bfa5-a5c2c7927129-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-e5f64c92-d386-4c49-bfa5-a5c2c7927129-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "cinder-quobyte-e5f64c92-d386-4c49-bfa5-a5c2c7927129" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:23 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4" returned: 0 in 0.572s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-e5f64c92-d386-4c49-bfa5-a5c2c7927129" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:23 devstack sudo[87116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be
Apr 24 14:46:23 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5449b62-9452-4685-bea8-64576dad0be4]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:23 devstack sudo[87118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129
Apr 24 14:46:23 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:23 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be" returned: 0 in 0.550s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:23 devstack sudo[87126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be
Apr 24 14:46:23 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:23 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129" returned: 0 in 0.568s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:23 devstack sudo[87128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129
Apr 24 14:46:23 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:24 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4.8cd567d9-5ee5-481c-8f29-bf7c616405be" returned: 0 in 0.428s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Lock "cinder-quobyte-8cd567d9-5ee5-481c-8f29-bf7c616405be" released by "_delete_snapshot" :: held 2.221s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.789s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.454s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1473371136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344b0d3f-6269-4fad-93f3-c5677d33b648,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c66a46faa9604f67b7c96dc9598aeeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:10Z,use_quota=True,user_id='a22b3a7c0d9b4ecc9b15bfb83ed3c0f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Creating volume 344b0d3f-6269-4fad-93f3-c5677d33b648 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:24 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:24 devstack sudo[87132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648 1073741824
Apr 24 14:46:24 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:24 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e5f64c92-d386-4c49-bfa5-a5c2c7927129" returned: 0 in 0.466s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-quobyte-e5f64c92-d386-4c49-bfa5-a5c2c7927129" released by "delete_volume" :: held 1.092s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:24 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1e244b09-589c-4b48-9e5a-0dfb9d46dcf4 tempest-GroupsV314Test-258987458 None] Create group from source-group-530000b5-30f4-4466-8f3e-4d77551d2aff completed successfully.
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Created reservations ['bb410f94-2407-4c3f-8e7f-bcac0d12d126', 'be36b2ea-d77b-443e-b052-3f5734b847b1', 'd17cb3be-20a7-4d7f-8d0b-3f31bbfd7a54', '4eb87dd0-efc1-4a26-874c-bd29703839cd'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:24 devstack sudo[87134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:24 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:24 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648 1073741824" returned: 0 in 0.641s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:25 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.512s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:25 devstack sudo[87140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648
Apr 24 14:46:25 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:25 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Deleted volume successfully.
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-00599a88-5f95-43d7-beac-f3547db47b92 tempest-CreateVolumesFromSnapshotTest-1344529066 None] Lock "cinder-e5f64c92-d386-4c49-bfa5-a5c2c7927129-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Acquiring lock "cinder-quobyte-609361c2-17fc-48f9-8340-a8409a3a85dc" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Lock "cinder-quobyte-609361c2-17fc-48f9-8340-a8409a3a85dc" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6952803d-50c7-4482-a93c-2e55b3d89868]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:25 devstack sudo[87142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc
Apr 24 14:46:25 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:25 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648" returned: 0 in 0.459s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 13.216s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-quobyte-a64508ed-a3e7-43f6-abd4-e46ca53857e6-42995768-0c25-472d-a2c9-74ddee6cf793" by "_create_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2295f0e7-4697-479f-b8fd-33ff59a8ad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344b0d3f-6269-4fad-93f3-c5677d33b648', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3710f0-4503-406d-b7e2-b59dc3a8e772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-a64508ed-a3e7-43f6-abd4-e46ca53857e6-42995768-0c25-472d-a2c9-74ddee6cf793" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Creating volume 42995768-0c25-472d-a2c9-74ddee6cf793 from snapshot a64508ed-a3e7-43f6-abd4-e46ca53857e6 {{(pid=81510) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-quobyte-42995768-0c25-472d-a2c9-74ddee6cf793" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:25 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Volume volume-344b0d3f-6269-4fad-93f3-c5677d33b648 (344b0d3f-6269-4fad-93f3-c5677d33b648): created successfully
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3710f0-4503-406d-b7e2-b59dc3a8e772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Flow 'volume_create_manager' (ddff1bb5-3e3c-4d62-a0e8-cc4696b75699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-42995768-0c25-472d-a2c9-74ddee6cf793" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] snapshot: a64508ed-a3e7-43f6-abd4-e46ca53857e6, volume: 42995768-0c25-472d-a2c9-74ddee6cf793,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:46:25 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-69a14988-ed98-412e-8ce7-51faeef75c72 tempest-VolumesListTestJSON-465617620 None] Created volume successfully.
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d402b-22c5-4dd4-96ab-513cbe7f6884]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:25 devstack sudo[87145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6
Apr 24 14:46:25 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:25 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc" returned: 0 in 0.578s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:25 devstack sudo[87150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc
Apr 24 14:46:25 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:26 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6" returned: 0 in 0.764s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd1d47b7-f858-45dc-83f7-387502271500(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b60c467-00ab-47c6-a4ff-1d7e05036461]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:26 devstack sudo[87156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500
Apr 24 14:46:26 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Flow 'volume_create_manager' (f1002c14-2594-4952-8a40-06db67798b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97834fa-98aa-4a09-9b20-577211f9229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97834fa-98aa-4a09-9b20-577211f9229c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-71656547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32681e18-3550-42a5-bd59-bc44469a9f2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c66a46faa9604f67b7c96dc9598aeeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:26Z,use_quota=True,user_id='a22b3a7c0d9b4ecc9b15bfb83ed3c0f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc07cdc9-616f-4bd1-b1fe-0ea9998bf3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc07cdc9-616f-4bd1-b1fe-0ea9998bf3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7aa9d38-7ff8-48b5-b2a8-d355fe1611fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7aa9d38-7ff8-48b5-b2a8-d355fe1611fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32681e18-3550-42a5-bd59-bc44469a9f2d', 'volume_name': 'volume-32681e18-3550-42a5-bd59-bc44469a9f2d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20ad7a1-282c-43b5-be3b-fddda1c12141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20ad7a1-282c-43b5-be3b-fddda1c12141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a021fc-a8f2-4125-9504-95540805f449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:26 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Volume 32681e18-3550-42a5-bd59-bc44469a9f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32681e18-3550-42a5-bd59-bc44469a9f2d', 'volume_size': 1}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:26 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-609361c2-17fc-48f9-8340-a8409a3a85dc" returned: 0 in 0.794s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Lock "cinder-quobyte-609361c2-17fc-48f9-8340-a8409a3a85dc" released by "delete_volume" :: held 1.425s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Created reservations ['08099860-897e-4ac2-b4a7-60c64f4f0742'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:26 devstack cinder-volume[81510]: WARNING cinder.quota [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1895852996 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1895852996, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:46:26 devstack cinder-volume[81510]: WARNING cinder.quota [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1895852996 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1895852996, it is now deprecated. Please use the default quota class for default quota.
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Created reservations ['7ead6614-fd3b-4eb5-9a35-cc0b808c5ee5', 'dadd6f8e-36f4-493c-be7f-d79b7164ce76', '009f93db-bf45-4750-852b-e1bce5952acf', '62fd978f-0739-49b0-80d8-6e8c13c8dbc3'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:26 devstack sudo[87159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:26 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:27 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500" returned: 0 in 0.726s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:27 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793 not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:46:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:27 devstack sudo[87164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793
Apr 24 14:46:27 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:27 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.489s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:27 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:27 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2f2a6092-c992-4bc2-ba68-9bc0d4fb8ba6 tempest-GroupsV314Test-258987458 None] Delete group completed successfully.
Apr 24 14:46:27 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Acquiring lock "cinder-quobyte-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:27 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Lock "cinder-quobyte-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4" acquired by "delete_volume" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:27 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe825976-0393-437f-9508-a2a06097c294]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:28 devstack sudo[87172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4
Apr 24 14:46:28 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (87d02826-20a2-4f75-97b4-2d6df613d94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebf7205-a988-4a30-95fc-7c6ec937c0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebf7205-a988-4a30-95fc-7c6ec937c0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1685100673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3085f0dd-9268-428b-9c0e-f445b68177bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:29Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6c8014-e3c5-4f13-b356-6dbbf7665521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6c8014-e3c5-4f13-b356-6dbbf7665521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb53ed2-9fa8-4247-955e-84e2f5777464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb53ed2-9fa8-4247-955e-84e2f5777464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3085f0dd-9268-428b-9c0e-f445b68177bc', 'volume_name': 'volume-3085f0dd-9268-428b-9c0e-f445b68177bc', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c152c8-72f0-4e94-984b-aea6a42dd804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c152c8-72f0-4e94-984b-aea6a42dd804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b4c584-58ec-4504-8f5d-5aaf2c4bc479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:28 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume 3085f0dd-9268-428b-9c0e-f445b68177bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3085f0dd-9268-428b-9c0e-f445b68177bc', 'volume_size': 1}
Apr 24 14:46:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:29 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4" returned: 0 in 1.319s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:29 devstack sudo[87183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4
Apr 24 14:46:29 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:30 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4" returned: 0 in 0.990s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Lock "cinder-quobyte-f6ac6759-9b6d-4dc8-8fa8-42da838c3ea4" released by "delete_volume" :: held 2.409s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:30 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Created reservations ['843553be-a8c0-4857-bae9-d8f9dde23244'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:30 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Created reservations ['bc52076d-fdc7-41e1-bb6e-ec87efae54b4', '507035a4-8628-4936-9ae7-52f98259b0a4', 'c218708e-10dd-40e7-8cec-7c19e3468b63', '8ea5424f-8949-476b-be24-e024ff69334c'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:30 devstack sudo[87186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:30 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:31 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.753s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:31 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:31 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-650e055d-a62b-4f90-960f-1d6c9c9b8ee8 tempest-GroupsV314Test-258987458 None] Delete group completed successfully.
Apr 24 14:46:32 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793" returned: 0 in 5.623s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:32 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce85952-8b6d-4345-bc16-924fadc4ddf6]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:32 devstack sudo[87190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500
Apr 24 14:46:32 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:33 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500" returned: 0 in 0.760s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:33 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793 {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:46:33 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Converted 1024.00 MB image at 182.08 MB/s
Apr 24 14:46:33 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793 is being set with open permissions: ugo+rw
Apr 24 14:46:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:33 devstack sudo[87195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793
Apr 24 14:46:33 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:34 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793" returned: 0 in 0.530s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-42995768-0c25-472d-a2c9-74ddee6cf793" released by "_copy_volume_from_snapshot" :: held 8.540s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-a64508ed-a3e7-43f6-abd4-e46ca53857e6-42995768-0c25-472d-a2c9-74ddee6cf793" released by "_create_volume_from_snapshot" :: held 8.605s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.657s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.490s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-71656547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32681e18-3550-42a5-bd59-bc44469a9f2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c66a46faa9604f67b7c96dc9598aeeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:26Z,use_quota=True,user_id='a22b3a7c0d9b4ecc9b15bfb83ed3c0f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Creating volume 32681e18-3550-42a5-bd59-bc44469a9f2d {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:34 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:34 devstack sudo[87198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d 1073741824
Apr 24 14:46:34 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dea110d-f0a0-4442-b9a9-02e18106a337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42995768-0c25-472d-a2c9-74ddee6cf793', 'volume_size': 1, 'snapshot_id': 'a64508ed-a3e7-43f6-abd4-e46ca53857e6'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4985a71-c181-42a3-8c72-a8faf4b30836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:34 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Volume volume-42995768-0c25-472d-a2c9-74ddee6cf793 (42995768-0c25-472d-a2c9-74ddee6cf793): created successfully
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4985a71-c181-42a3-8c72-a8faf4b30836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Flow 'volume_create_manager' (76de55be-48fd-4d1c-b99a-f6ed84cb2c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:34 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-bdb18764-ed69-4633-a4b8-7e10110adb80 tempest-VolumesDeleteCascade-30890766 None] Created volume successfully.
Apr 24 14:46:34 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d 1073741824" returned: 0 in 0.612s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:34 devstack sudo[87203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d
Apr 24 14:46:34 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-cd1d47b7-f858-45dc-83f7-387502271500-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-cd1d47b7-f858-45dc-83f7-387502271500-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Performing cascade delete. {{(pid=81510) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-a64508ed-a3e7-43f6-abd4-e46ca53857e6-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-a64508ed-a3e7-43f6-abd4-e46ca53857e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-quobyte-cd1d47b7-f858-45dc-83f7-387502271500" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-cd1d47b7-f858-45dc-83f7-387502271500" acquired by "delete_snapshot" :: waited 0.044s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-quobyte-a64508ed-a3e7-43f6-abd4-e46ca53857e6" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-a64508ed-a3e7-43f6-abd4-e46ca53857e6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Deleting offline snapshot a64508ed-a3e7-43f6-abd4-e46ca53857e6 of volume cd1d47b7-f858-45dc-83f7-387502271500 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] snapshot_file for this snap is: volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5e7aff-e248-4e98-abc3-3d1936e5a33e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:35 devstack sudo[87205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6
Apr 24 14:46:35 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:35 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d" returned: 0 in 0.521s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.603s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1685100673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3085f0dd-9268-428b-9c0e-f445b68177bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:29Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Creating volume 3085f0dd-9268-428b-9c0e-f445b68177bc {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:35 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a021fc-a8f2-4125-9504-95540805f449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32681e18-3550-42a5-bd59-bc44469a9f2d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:35 devstack sudo[87208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc 1073741824
Apr 24 14:46:35 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80e4e1c-a39c-4f94-8b2c-429d1f953604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:35 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Volume volume-32681e18-3550-42a5-bd59-bc44469a9f2d (32681e18-3550-42a5-bd59-bc44469a9f2d): created successfully
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80e4e1c-a39c-4f94-8b2c-429d1f953604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Flow 'volume_create_manager' (f1002c14-2594-4952-8a40-06db67798b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:35 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-34d42ef5-6251-415e-a09f-7065df9e4faf tempest-VolumesListTestJSON-465617620 None] Created volume successfully.
Apr 24 14:46:35 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6" returned: 0 in 0.610s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd1d47b7-f858-45dc-83f7-387502271500(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ada6d6a-2cb6-4472-82de-5b7da7f0bb4a]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:35 devstack sudo[87216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500
Apr 24 14:46:35 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:36 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc 1073741824" returned: 0 in 0.703s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:36 devstack sudo[87218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc
Apr 24 14:46:36 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:36 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500" returned: 0 in 0.606s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:36 devstack sudo[87223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6
Apr 24 14:46:36 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:36 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc" returned: 0 in 0.554s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:36 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b4c584-58ec-4504-8f5d-5aaf2c4bc479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3085f0dd-9268-428b-9c0e-f445b68177bc', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:36 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0d673a-edf5-492b-b9b6-2e6ebb5dcf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:36 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume volume-3085f0dd-9268-428b-9c0e-f445b68177bc (3085f0dd-9268-428b-9c0e-f445b68177bc): created successfully
Apr 24 14:46:36 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0d673a-edf5-492b-b9b6-2e6ebb5dcf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:36 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (87d02826-20a2-4f75-97b4-2d6df613d94b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:36 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-65784384-00bc-475a-9679-6a2835bbba9e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created volume successfully.
Apr 24 14:46:37 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6" returned: 0 in 0.621s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:37 devstack sudo[87229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6
Apr 24 14:46:37 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (d01f4b75-be4e-469f-bdb8-30df6d389e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a67a9fa-f579-4c82-ae86-715963723ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a67a9fa-f579-4c82-ae86-715963723ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1485727065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f52fee-9cb1-4837-bd60-cfd4c6110062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:38Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d30fee-0314-4a2f-a3b3-3f55906574a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d30fee-0314-4a2f-a3b3-3f55906574a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b539699-7d3c-43bc-9ebb-a33cbe26430f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b539699-7d3c-43bc-9ebb-a33cbe26430f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f52fee-9cb1-4837-bd60-cfd4c6110062', 'volume_name': 'volume-48f52fee-9cb1-4837-bd60-cfd4c6110062', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5273e7c-35d4-4eac-b759-759032508a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5273e7c-35d4-4eac-b759-759032508a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a3225c-2f45-4f25-8018-765f1c78c359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:37 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume 48f52fee-9cb1-4837-bd60-cfd4c6110062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f52fee-9cb1-4837-bd60-cfd4c6110062', 'volume_size': 1}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1485727065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f52fee-9cb1-4837-bd60-cfd4c6110062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:38Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Creating volume 48f52fee-9cb1-4837-bd60-cfd4c6110062 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:37 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:37 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500.a64508ed-a3e7-43f6-abd4-e46ca53857e6" returned: 0 in 0.673s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:37 devstack sudo[87232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062 1073741824
Apr 24 14:46:37 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-a64508ed-a3e7-43f6-abd4-e46ca53857e6" released by "_delete_snapshot" :: held 2.606s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-cd1d47b7-f858-45dc-83f7-387502271500" released by "delete_snapshot" :: held 2.643s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:37 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Created reservations ['e854be8b-fed8-432c-921d-896376e614f6', '8454aa2b-548f-4ecd-bb10-0d1272da23c4', 'fc814de5-0b40-48c8-813b-f58d95de6e23', '67a22a76-64c4-408e-9e9e-42eca0356e2d'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:38 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Delete snapshot completed successfully.
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-a64508ed-a3e7-43f6-abd4-e46ca53857e6-delete_snapshot" released by "delete_snapshot" :: held 2.953s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Snapshots deleted, issuing volume delete {{(pid=81510) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-quobyte-cd1d47b7-f858-45dc-83f7-387502271500" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-cd1d47b7-f858-45dc-83f7-387502271500" acquired by "delete_volume" :: waited 0.030s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e370f52-b27c-4e0d-9f7c-101e7e796c24]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (04f1cfab-a3a3-48ad-994d-8f02a2bce242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dec6d2-9f59-4cbb-a8de-775adab75911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dec6d2-9f59-4cbb-a8de-775adab75911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1664753842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:38Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0847e4-497b-4912-b5f0-0a798d9f6087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0847e4-497b-4912-b5f0-0a798d9f6087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc91d25-82df-4cce-bfaf-bdbe11af17d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc91d25-82df-4cce-bfaf-bdbe11af17d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19', 'volume_name': 'volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429687bd-7b70-4231-aebe-a1c1c50dc0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429687bd-7b70-4231-aebe-a1c1c50dc0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eedfc93-30f3-4228-9173-cfcaeb819779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:38 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume 8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19', 'volume_size': 1}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:38 devstack sudo[87234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500
Apr 24 14:46:38 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (ee8d7a95-7354-4cef-9919-2aa3ff9bb13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47116768-6d46-4fc9-af24-0e6900e1c6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47116768-6d46-4fc9-af24-0e6900e1c6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-233209501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa1e19a-2a92-4d91-893a-7a812e005843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:38Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03efddf4-91be-4f89-90cf-5f5f6d1dcdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03efddf4-91be-4f89-90cf-5f5f6d1dcdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22f19fe-48ee-4e47-84a5-179875bf82ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22f19fe-48ee-4e47-84a5-179875bf82ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa1e19a-2a92-4d91-893a-7a812e005843', 'volume_name': 'volume-aaa1e19a-2a92-4d91-893a-7a812e005843', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6518c3eb-281c-4038-aae9-85317f2f38c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6518c3eb-281c-4038-aae9-85317f2f38c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd80e6c7-793e-4881-91c0-fd77cbff6a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:38 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume aaa1e19a-2a92-4d91-893a-7a812e005843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa1e19a-2a92-4d91-893a-7a812e005843', 'volume_size': 1}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:38 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062 1073741824" returned: 0 in 1.044s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:38 devstack sudo[87239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062
Apr 24 14:46:38 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Acquiring lock "cinder-32681e18-3550-42a5-bd59-bc44469a9f2d-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Lock "cinder-32681e18-3550-42a5-bd59-bc44469a9f2d-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (729758c1-2ab9-4c13-a9bc-9b1d517b7038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641a13b6-550c-45cf-ab17-ab95f7f2ca4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641a13b6-550c-45cf-ab17-ab95f7f2ca4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-376109876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6632b3a-9127-40aa-b540-14d2e3ddb4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:39Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37dd3caf-1063-418b-862a-fbd675d9ba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37dd3caf-1063-418b-862a-fbd675d9ba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2be9b08-c225-4cd6-b725-873fb6cac73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2be9b08-c225-4cd6-b725-873fb6cac73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6632b3a-9127-40aa-b540-14d2e3ddb4a3', 'volume_name': 'volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d04c59b-9aba-460a-ac42-82336e07679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:39 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d04c59b-9aba-460a-ac42-82336e07679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066349fa-659c-4535-9e18-2b38d91094f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:39 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume a6632b3a-9127-40aa-b540-14d2e3ddb4a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3', 'volume_size': 1}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500" returned: 0 in 1.064s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Acquiring lock "cinder-quobyte-32681e18-3550-42a5-bd59-bc44469a9f2d" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:39 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500
Apr 24 14:46:39 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Lock "cinder-quobyte-32681e18-3550-42a5-bd59-bc44469a9f2d" acquired by "delete_volume" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[79592fff-459c-4cdf-8dd4-0df264104843]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:39 devstack sudo[87246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d
Apr 24 14:46:39 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (85ea4f7b-994d-4aba-9241-a4ae83c4614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22570e1c-5e01-4f47-b579-7824344dc865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22570e1c-5e01-4f47-b579-7824344dc865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926650440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ae2f83-6981-4453-b926-6fa0719900cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:39Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfc9fd6-e12e-4ca2-af73-c653c5021c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfc9fd6-e12e-4ca2-af73-c653c5021c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5857e05c-d3d6-4796-b561-6daa2920b973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5857e05c-d3d6-4796-b561-6daa2920b973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ae2f83-6981-4453-b926-6fa0719900cd', 'volume_name': 'volume-62ae2f83-6981-4453-b926-6fa0719900cd', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2fdede-7fec-4523-ad37-75254491839d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2fdede-7fec-4523-ad37-75254491839d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ad5836-0e84-4a13-b64a-d367b9350b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:39 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume 62ae2f83-6981-4453-b926-6fa0719900cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ae2f83-6981-4453-b926-6fa0719900cd', 'volume_size': 1}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:39 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062" returned: 0 in 0.969s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.441s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1664753842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:38Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Creating volume 8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:39 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:39 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a3225c-2f45-4f25-8018-765f1c78c359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f52fee-9cb1-4837-bd60-cfd4c6110062', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc021766-8241-46f4-bfe7-5aeeee4dd4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:39 devstack sudo[87251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19 1073741824
Apr 24 14:46:39 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd1d47b7-f858-45dc-83f7-387502271500" returned: 0 in 0.652s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-cd1d47b7-f858-45dc-83f7-387502271500" released by "delete_volume" :: held 1.802s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:39 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume volume-48f52fee-9cb1-4837-bd60-cfd4c6110062 (48f52fee-9cb1-4837-bd60-cfd4c6110062): created successfully
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc021766-8241-46f4-bfe7-5aeeee4dd4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (d01f4b75-be4e-469f-bdb8-30df6d389e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:39 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-8c1dc51b-4fab-42e8-a8d3-7d488741ca93 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created volume successfully.
Apr 24 14:46:39 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d" returned: 0 in 0.666s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:39 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Created reservations ['a3fd8646-3213-4d55-a82f-2e39ecb230ae', 'a26335ef-c3c3-4892-99c1-6e281d64a9e7', '90ff4711-b699-4e54-84c5-f7fe13e2399a', 'a40d0ed5-ffee-4a46-ab8d-de0de6fa0452'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:39 devstack sudo[87255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d
Apr 24 14:46:39 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:40 devstack sudo[87257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:40 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:40 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19 1073741824" returned: 0 in 0.792s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:40 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-32681e18-3550-42a5-bd59-bc44469a9f2d" returned: 0 in 0.672s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Lock "cinder-quobyte-32681e18-3550-42a5-bd59-bc44469a9f2d" released by "delete_volume" :: held 1.391s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:40 devstack sudo[87263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19
Apr 24 14:46:40 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Created reservations ['e8182869-0b34-4f5a-9967-f3f75f609558', '275907ed-fd93-4914-a8bd-189454937da2', 'ff4c1d24-2b4f-424e-b984-9a61eec13a22', '30741385-0db4-4b60-be41-a95164395348'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:40 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.749s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-42995768-0c25-472d-a2c9-74ddee6cf793-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:40 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Deleted volume successfully.
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6d802996-7954-4b63-83a1-580ff0d4b917 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-cd1d47b7-f858-45dc-83f7-387502271500-delete_volume" released by "delete_volume" :: held 5.839s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-42995768-0c25-472d-a2c9-74ddee6cf793-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "cinder-quobyte-42995768-0c25-472d-a2c9-74ddee6cf793" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:40 devstack sudo[87266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:40 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-42995768-0c25-472d-a2c9-74ddee6cf793" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18f1268-75b6-4629-8dc7-ac095ab39f6f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:41 devstack sudo[87268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793
Apr 24 14:46:41 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:41 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19" returned: 0 in 0.721s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.863s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-233209501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa1e19a-2a92-4d91-893a-7a812e005843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:38Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Creating volume aaa1e19a-2a92-4d91-893a-7a812e005843 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:41 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eedfc93-30f3-4228-9173-cfcaeb819779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:41 devstack sudo[87272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843 1073741824
Apr 24 14:46:41 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b3cd53-e0a1-440e-8b32-7388fe18551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:DELETE=12,cinder:SELECT=178,cinder:UPDATE=216,cinder:INSERT=52 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:46:41 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19 (8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19): created successfully
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b3cd53-e0a1-440e-8b32-7388fe18551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (04f1cfab-a3a3-48ad-994d-8f02a2bce242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Acquiring lock "cinder-344b0d3f-6269-4fad-93f3-c5677d33b648-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:41 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f483fca8-43c6-445e-af0b-f30b4df0ebaa tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created volume successfully.
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Lock "cinder-344b0d3f-6269-4fad-93f3-c5677d33b648-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:41 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Acquiring lock "cinder-quobyte-344b0d3f-6269-4fad-93f3-c5677d33b648" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.771s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:41 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Deleted volume successfully.
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Lock "cinder-quobyte-344b0d3f-6269-4fad-93f3-c5677d33b648" acquired by "delete_volume" :: waited 0.056s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-550c69fe-e7a4-4dff-943d-8122f7b8466c tempest-VolumesListTestJSON-465617620 None] Lock "cinder-32681e18-3550-42a5-bd59-bc44469a9f2d-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e497d2d9-dc20-4440-b77a-744ab588b238]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:41 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793" returned: 0 in 0.896s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:41 devstack sudo[87277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648
Apr 24 14:46:41 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:41 devstack sudo[87278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793
Apr 24 14:46:41 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:42 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843 1073741824" returned: 0 in 0.816s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:42 devstack sudo[87285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843
Apr 24 14:46:42 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:42 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648" returned: 0 in 0.707s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:42 devstack sudo[87291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648
Apr 24 14:46:42 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:42 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-42995768-0c25-472d-a2c9-74ddee6cf793" returned: 0 in 0.632s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-quobyte-42995768-0c25-472d-a2c9-74ddee6cf793" released by "delete_volume" :: held 1.571s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Created reservations ['0e14c2f5-962b-4237-a34c-1e82330ff42d', 'e8075978-4141-4f92-ba12-57e021c12c1c', 'f5ebe937-8c80-4cee-9e2a-b6af913216c7', '1fac6862-5821-450f-8a2e-c0e5bd40ffb8'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:42 devstack sudo[87293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:42 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:42 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843" returned: 0 in 0.605s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.691s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-376109876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6632b3a-9127-40aa-b540-14d2e3ddb4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:39Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Creating volume a6632b3a-9127-40aa-b540-14d2e3ddb4a3 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:42 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:42 devstack sudo[87296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3 1073741824
Apr 24 14:46:42 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd80e6c7-793e-4881-91c0-fd77cbff6a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa1e19a-2a92-4d91-893a-7a812e005843', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfd4493-3dae-4b2e-b991-e157b9353c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:42 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:UPDATE=208,cinder:SELECT=162,cinder:INSERT=52,cinder:DELETE=20 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:46:42 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume volume-aaa1e19a-2a92-4d91-893a-7a812e005843 (aaa1e19a-2a92-4d91-893a-7a812e005843): created successfully
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfd4493-3dae-4b2e-b991-e157b9353c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (ee8d7a95-7354-4cef-9919-2aa3ff9bb13a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-33f73b18-c1cf-4eb8-943b-010177d25884 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created volume successfully.
Apr 24 14:46:43 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-344b0d3f-6269-4fad-93f3-c5677d33b648" returned: 0 in 0.724s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Lock "cinder-quobyte-344b0d3f-6269-4fad-93f3-c5677d33b648" released by "delete_volume" :: held 1.502s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Created reservations ['e10f359a-0d24-4ada-b959-93bb9dd5a1b6', '5a80081b-085e-45a2-bab7-da974ffec609', '606c891f-e0a7-4e47-b2f9-2f87a48b8c89', '6326531c-eec1-4882-8876-2ab890d3de59'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:43 devstack sudo[87301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:43 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:43 devstack sudo[87300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:43 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:43 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.965s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Deleted volume successfully.
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3f44ac5b-92f4-4f54-b2f0-ae132ae94d80 tempest-VolumesDeleteCascade-30890766 None] Lock "cinder-42995768-0c25-472d-a2c9-74ddee6cf793-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Acquiring lock "cinder-e3d719fc-3bf0-4614-9a05-35a8e2d376e3-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Lock "cinder-e3d719fc-3bf0-4614-9a05-35a8e2d376e3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Acquiring lock "cinder-quobyte-e3d719fc-3bf0-4614-9a05-35a8e2d376e3" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Lock "cinder-quobyte-e3d719fc-3bf0-4614-9a05-35a8e2d376e3" acquired by "delete_volume" :: waited 0.030s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d219e20-c47c-4797-94ba-817b7e2c0bf4]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:44 devstack sudo[87309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3
Apr 24 14:46:44 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:44 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3 1073741824" returned: 0 in 1.448s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:44 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.074s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:44 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Deleted volume successfully.
Apr 24 14:46:44 devstack sudo[87312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3
Apr 24 14:46:44 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b555a217-483a-454c-b04e-c66462b88e16 tempest-VolumesListTestJSON-465617620 None] Lock "cinder-344b0d3f-6269-4fad-93f3-c5677d33b648-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:44 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.175s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:44 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3" returned: 0 in 0.787s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:45 devstack sudo[87317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3
Apr 24 14:46:45 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Flow 'volume_create_manager' (72ff2582-1ddc-4228-b73d-95ad6de71167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e6cfbd-f4fc-4a54-a8f5-ef9b89a9a861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e6cfbd-f4fc-4a54-a8f5-ef9b89a9a861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1353816543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7c26e4-6742-4eb3-ad78-b6f75108f793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8801ef52ea6840a19dc7ffa9cf3f594c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:45Z,use_quota=True,user_id='ce263ce4fbb7432bbaff1af1040a9481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4b9dec-3f5d-43e1-91ff-535f8974d832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4b9dec-3f5d-43e1-91ff-535f8974d832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc42a2e8-8633-4544-b312-42e28a43ecd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc42a2e8-8633-4544-b312-42e28a43ecd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7c26e4-6742-4eb3-ad78-b6f75108f793', 'volume_name': 'volume-de7c26e4-6742-4eb3-ad78-b6f75108f793', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6361e5-4c2d-4ccf-b412-3877bbb1c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6361e5-4c2d-4ccf-b412-3877bbb1c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f03b22-19e8-4b14-9351-31fc781acbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:45 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Volume de7c26e4-6742-4eb3-ad78-b6f75108f793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7c26e4-6742-4eb3-ad78-b6f75108f793', 'volume_size': 1}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:45 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3" returned: 0 in 0.853s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.654s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926650440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ae2f83-6981-4453-b926-6fa0719900cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91229461336048dd9c6a3153fbcf267e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:39Z,use_quota=True,user_id='63c59082063d4407a41dec0fa775bb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Creating volume 62ae2f83-6981-4453-b926-6fa0719900cd {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:45 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:45 devstack sudo[87320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd 1073741824
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066349fa-659c-4535-9e18-2b38d91094f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:45 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60ae597-49e7-4bb4-812b-d92cf12f583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:45 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3 (a6632b3a-9127-40aa-b540-14d2e3ddb4a3): created successfully
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60ae597-49e7-4bb4-812b-d92cf12f583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (729758c1-2ab9-4c13-a9bc-9b1d517b7038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:45 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-def9731c-8f6b-48f8-ad61-27f67155a50a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created volume successfully.
Apr 24 14:46:45 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e3d719fc-3bf0-4614-9a05-35a8e2d376e3" returned: 0 in 0.583s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Lock "cinder-quobyte-e3d719fc-3bf0-4614-9a05-35a8e2d376e3" released by "delete_volume" :: held 1.431s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Created reservations ['1b6957b9-7b6b-423e-9320-922a9a56da19', 'dcba7b5a-feb7-4f93-929d-c6fa9c551baf', '8928a54d-41d8-4b02-9c02-a328cc47eb16', 'eb4f799a-4761-486e-bee6-77841991b820'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:45 devstack sudo[87325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:45 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:45 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd 1073741824" returned: 0 in 0.728s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:46 devstack sudo[87328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd
Apr 24 14:46:46 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:46 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.601s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:46 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Deleted volume successfully.
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-18417632-f9d4-4951-b39d-91ae5ae736cc tempest-VolumesListTestJSON-465617620 None] Lock "cinder-e3d719fc-3bf0-4614-9a05-35a8e2d376e3-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:46 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd" returned: 0 in 0.544s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.349s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1353816543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7c26e4-6742-4eb3-ad78-b6f75108f793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8801ef52ea6840a19dc7ffa9cf3f594c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:45Z,use_quota=True,user_id='ce263ce4fbb7432bbaff1af1040a9481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Creating volume de7c26e4-6742-4eb3-ad78-b6f75108f793 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:46 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:46 devstack sudo[87332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793 1073741824
Apr 24 14:46:46 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ad5836-0e84-4a13-b64a-d367b9350b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ae2f83-6981-4453-b926-6fa0719900cd', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5593d0-64a7-4b54-9287-80815c05db06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:46 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Volume volume-62ae2f83-6981-4453-b926-6fa0719900cd (62ae2f83-6981-4453-b926-6fa0719900cd): created successfully
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5593d0-64a7-4b54-9287-80815c05db06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Flow 'volume_create_manager' (85ea4f7b-994d-4aba-9241-a4ae83c4614e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:46 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-68c4e2ed-940a-446c-b022-2b327e06574e tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created volume successfully.
Apr 24 14:46:47 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793 1073741824" returned: 0 in 0.881s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:47 devstack sudo[87337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793
Apr 24 14:46:47 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:47 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-62ae2f83-6981-4453-b926-6fa0719900cd-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:47 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-62ae2f83-6981-4453-b926-6fa0719900cd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:47 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-quobyte-62ae2f83-6981-4453-b926-6fa0719900cd" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:47 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-62ae2f83-6981-4453-b926-6fa0719900cd" acquired by "delete_volume" :: waited 0.038s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:47 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd61a051-9c27-4df7-9277-9c88a0bf63f6]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:47 devstack sudo[87339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd
Apr 24 14:46:47 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:48 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793" returned: 0 in 0.555s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f03b22-19e8-4b14-9351-31fc781acbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7c26e4-6742-4eb3-ad78-b6f75108f793', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44642ea-fd0c-4072-885b-17dbbfb716f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:48 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Volume volume-de7c26e4-6742-4eb3-ad78-b6f75108f793 (de7c26e4-6742-4eb3-ad78-b6f75108f793): created successfully
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44642ea-fd0c-4072-885b-17dbbfb716f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Flow 'volume_create_manager' (72ff2582-1ddc-4228-b73d-95ad6de71167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:48 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-bcd22478-1111-490c-b70e-b90e6c8ea9d1 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Created volume successfully.
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Acquiring lock "cinder-de7c26e4-6742-4eb3-ad78-b6f75108f793-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "cinder-de7c26e4-6742-4eb3-ad78-b6f75108f793-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Acquiring lock "cinder-quobyte-de7c26e4-6742-4eb3-ad78-b6f75108f793" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "cinder-quobyte-de7c26e4-6742-4eb3-ad78-b6f75108f793" acquired by "delete_volume" :: waited 0.039s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c34450-f5dd-4667-bd89-c3a1db9b3cc9]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:48 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd" returned: 0 in 0.875s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:48 devstack sudo[87346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd
Apr 24 14:46:48 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Flow 'volume_create_manager' (82687c82-235f-4a8a-8c9f-1854123ccbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e247e802-970a-4a88-a511-da87366d0ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:48 devstack sudo[87345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793
Apr 24 14:46:48 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e247e802-970a-4a88-a511-da87366d0ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-767544097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08925607-5e70-47ba-b374-52bc14cc9557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a71b25b53f423b814223fb1d82811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:49Z,use_quota=True,user_id='a1b52757854648c0b81d38edc7744444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc29f1e-7271-411c-8b3d-02e61a514a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc29f1e-7271-411c-8b3d-02e61a514a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233d87b3-5ef5-45fc-988b-edcc6f3e4a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233d87b3-5ef5-45fc-988b-edcc6f3e4a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08925607-5e70-47ba-b374-52bc14cc9557', 'volume_name': 'volume-08925607-5e70-47ba-b374-52bc14cc9557', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fc4347-04c8-42e9-bb53-ac9c65ce08b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fc4347-04c8-42e9-bb53-ac9c65ce08b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f66cf4f-750f-45b6-8b58-e5c315a0a4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:48 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Volume 08925607-5e70-47ba-b374-52bc14cc9557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08925607-5e70-47ba-b374-52bc14cc9557', 'volume_size': 1}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-767544097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08925607-5e70-47ba-b374-52bc14cc9557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a71b25b53f423b814223fb1d82811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:49Z,use_quota=True,user_id='a1b52757854648c0b81d38edc7744444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Creating volume 08925607-5e70-47ba-b374-52bc14cc9557 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:48 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:48 devstack sudo[87349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557 1073741824
Apr 24 14:46:48 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:49 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62ae2f83-6981-4453-b926-6fa0719900cd" returned: 0 in 0.530s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:49 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793" returned: 0 in 0.575s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-62ae2f83-6981-4453-b926-6fa0719900cd" released by "delete_volume" :: held 1.478s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:49 devstack sudo[87355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793
Apr 24 14:46:49 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created reservations ['f3317288-d8c4-41b9-8028-f19b7c030639', 'a9544f7a-b13e-48bd-b275-d9a5966ee491', 'da0cbfa0-9514-4298-bab5-df9146788cd6', '1dc04da4-fc40-4ba2-8199-259239fc84da'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:49 devstack sudo[87360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:49 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:49 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557 1073741824" returned: 0 in 0.803s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:49 devstack sudo[87362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557
Apr 24 14:46:49 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:49 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-de7c26e4-6742-4eb3-ad78-b6f75108f793" returned: 0 in 0.604s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "cinder-quobyte-de7c26e4-6742-4eb3-ad78-b6f75108f793" released by "delete_volume" :: held 1.277s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Created reservations ['eb6aafcd-776a-4a46-a130-d6adcbf9da50', '8adc996c-5567-4174-b0e5-5e096eaa119e', '5589a0a3-07c3-4979-ab77-89e83e52dc2e', '73a57eee-d220-4cf3-b34a-6fc1f4b0c998'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-a6632b3a-9127-40aa-b540-14d2e3ddb4a3-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-a6632b3a-9127-40aa-b540-14d2e3ddb4a3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:49 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-quobyte-a6632b3a-9127-40aa-b540-14d2e3ddb4a3" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.679s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:50 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Deleted volume successfully.
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-a6632b3a-9127-40aa-b540-14d2e3ddb4a3" acquired by "delete_volume" :: waited 0.056s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-384a3580-804b-44b0-a324-665d5eca70bf tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-62ae2f83-6981-4453-b926-6fa0719900cd-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:50 devstack sudo[87366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:50 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d3a828-076a-496b-a63c-d062bef6a930]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:50 devstack sudo[87370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3
Apr 24 14:46:50 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:50 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557" returned: 0 in 0.695s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f66cf4f-750f-45b6-8b58-e5c315a0a4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08925607-5e70-47ba-b374-52bc14cc9557', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d6f2d4-9223-4aa5-9b07-bfe10ce80a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:50 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Volume volume-08925607-5e70-47ba-b374-52bc14cc9557 (08925607-5e70-47ba-b374-52bc14cc9557): created successfully
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d6f2d4-9223-4aa5-9b07-bfe10ce80a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Flow 'volume_create_manager' (82687c82-235f-4a8a-8c9f-1854123ccbe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:50 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-14048281-1c3a-4f2d-96b0-a9ecb4704bf1 tempest-VolumesTransfersTest-1739853637 None] Created volume successfully.
Apr 24 14:46:50 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.622s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:50 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Deleted volume successfully.
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-67eca549-ddc7-4054-b3a8-ab57fa082249 tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "cinder-de7c26e4-6742-4eb3-ad78-b6f75108f793-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:50 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3" returned: 0 in 0.662s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:50 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3
Apr 24 14:46:50 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Flow 'volume_create_manager' (0e6093db-5410-4cbf-ac97-fcd4b4a42fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97753d9-92e9-4cf3-aec4-9193e3bad02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97753d9-92e9-4cf3-aec4-9193e3bad02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1933016828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66807284-b695-418f-a136-935cec8e8629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8801ef52ea6840a19dc7ffa9cf3f594c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:51Z,use_quota=True,user_id='ce263ce4fbb7432bbaff1af1040a9481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eef9e58-a052-4968-a9b6-a68b611cb61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eef9e58-a052-4968-a9b6-a68b611cb61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9301c23-bd47-4434-bc14-1a1db89a9773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9301c23-bd47-4434-bc14-1a1db89a9773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66807284-b695-418f-a136-935cec8e8629', 'volume_name': 'volume-66807284-b695-418f-a136-935cec8e8629', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4997c0e4-cb9f-4f75-9d72-256056eef1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4997c0e4-cb9f-4f75-9d72-256056eef1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:51 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd10f174-a6d8-46b9-98df-49a032550706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:51 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Volume 66807284-b695-418f-a136-935cec8e8629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66807284-b695-418f-a136-935cec8e8629', 'volume_size': 1}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1933016828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66807284-b695-418f-a136-935cec8e8629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8801ef52ea6840a19dc7ffa9cf3f594c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:51Z,use_quota=True,user_id='ce263ce4fbb7432bbaff1af1040a9481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Creating volume 66807284-b695-418f-a136-935cec8e8629 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:51 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a6632b3a-9127-40aa-b540-14d2e3ddb4a3" returned: 0 in 0.625s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-a6632b3a-9127-40aa-b540-14d2e3ddb4a3" released by "delete_volume" :: held 1.336s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:51 devstack sudo[87380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629 1073741824
Apr 24 14:46:51 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created reservations ['de30378f-3083-48b5-b4a9-eaf494d53a36', '90c1820a-ba09-482c-b486-274a18b6b160', 'cb86909f-9252-4dea-80c6-153a99d8a527', '8b7582fd-36c2-494a-bfa2-a3a9c981a12d'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:51 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a732cb08-a490-4d33-af30-d8c3e846ee63 tempest-VolumesTransfersTest-1716169104 None] Transfer volume completed successfully.
Apr 24 14:46:51 devstack sudo[87382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:51 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:52 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.605s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:52 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629 1073741824" returned: 0 in 0.787s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:52 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Deleted volume successfully.
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-327d1d21-0bc6-40af-a5a4-0baae61bf8d4 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-a6632b3a-9127-40aa-b540-14d2e3ddb4a3-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-aaa1e19a-2a92-4d91-893a-7a812e005843-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:52 devstack sudo[87395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629
Apr 24 14:46:52 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-aaa1e19a-2a92-4d91-893a-7a812e005843-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-quobyte-aaa1e19a-2a92-4d91-893a-7a812e005843" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-aaa1e19a-2a92-4d91-893a-7a812e005843" acquired by "delete_volume" :: waited 0.029s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f91c54-d0fb-4955-8b73-06dcca3f7818]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:52 devstack sudo[87397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843
Apr 24 14:46:52 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Acquiring lock "cinder-08925607-5e70-47ba-b374-52bc14cc9557-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Lock "cinder-08925607-5e70-47ba-b374-52bc14cc9557-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Acquiring lock "cinder-quobyte-08925607-5e70-47ba-b374-52bc14cc9557" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Lock "cinder-quobyte-08925607-5e70-47ba-b374-52bc14cc9557" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34e4985-4a98-4d9a-82c0-0bd6cc1b140b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:52 devstack sudo[87399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557
Apr 24 14:46:52 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:52 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629" returned: 0 in 0.661s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd10f174-a6d8-46b9-98df-49a032550706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66807284-b695-418f-a136-935cec8e8629', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c22bb8-b3c0-4344-961c-b064446e3adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:52 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Volume volume-66807284-b695-418f-a136-935cec8e8629 (66807284-b695-418f-a136-935cec8e8629): created successfully
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c22bb8-b3c0-4344-961c-b064446e3adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Flow 'volume_create_manager' (0e6093db-5410-4cbf-ac97-fcd4b4a42fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:52 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-74265a73-9409-4738-8e15-2685518e597e tempest-VolumeQuotasAdminTestJSON-2016647146 None] Created volume successfully.
Apr 24 14:46:53 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843" returned: 0 in 0.676s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:53 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843
Apr 24 14:46:53 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:53 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557" returned: 0 in 0.604s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:53 devstack sudo[87410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557
Apr 24 14:46:53 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:53 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aaa1e19a-2a92-4d91-893a-7a812e005843" returned: 0 in 0.538s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-aaa1e19a-2a92-4d91-893a-7a812e005843" released by "delete_volume" :: held 1.274s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created reservations ['21d57fef-9630-44ae-8b40-ab195a1b26d1', 'b129aa28-c4ad-450c-8c0a-2484063a0a86', '1ee61d55-f177-45e6-971d-07a8e50cfa52', '3fd4f48b-1c2c-4ca1-bbd3-a09b59e14aaa'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:53 devstack sudo[87414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:53 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:54 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-08925607-5e70-47ba-b374-52bc14cc9557" returned: 0 in 0.654s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Lock "cinder-quobyte-08925607-5e70-47ba-b374-52bc14cc9557" released by "delete_volume" :: held 1.310s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Created reservations ['6ac298d0-018d-4f64-937b-726a381378c8', '985bce8b-5a24-478f-9f43-86cc59af9ad2', '958c4b91-0b4a-4cf5-96c3-ead7e4efbc13', 'b55510a4-15b6-410e-8f44-5c8f3adee466'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-76ce14b0-106c-4229-901c-c07e4916a307 tempest-VolumeQuotasAdminTestJSON-1187947513 None] Transfer volume completed successfully.
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:54 devstack sudo[87416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:54 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:54 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.612s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Deleted volume successfully.
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ff2e5c9-fcb4-4c6f-917c-702418ee9c4a tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-aaa1e19a-2a92-4d91-893a-7a812e005843-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-quobyte-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19" acquired by "delete_volume" :: waited 0.037s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eba71bd-15b9-4dcf-8bfb-b84ccca73ccc]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:54 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.641s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Deleted volume successfully.
Apr 24 14:46:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-39cb8c01-46a5-48a6-9d65-b0e46979e7de tempest-VolumesTransfersTest-1579148521 None] Lock "cinder-08925607-5e70-47ba-b374-52bc14cc9557-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:54 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19
Apr 24 14:46:54 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Acquiring lock "cinder-66807284-b695-418f-a136-935cec8e8629-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Lock "cinder-66807284-b695-418f-a136-935cec8e8629-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Acquiring lock "cinder-quobyte-66807284-b695-418f-a136-935cec8e8629" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Lock "cinder-quobyte-66807284-b695-418f-a136-935cec8e8629" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bcb9e2-f916-4cb5-8d08-0ccf77c41936]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:55 devstack sudo[87422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629
Apr 24 14:46:55 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:55 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19" returned: 0 in 0.840s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:55 devstack sudo[87427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19
Apr 24 14:46:55 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Flow 'volume_create_manager' (76409709-2688-4284-af3e-99d5b8d648a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa8c5dc-fc51-46d0-b2bd-45624a0f6f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa8c5dc-fc51-46d0-b2bd-45624a0f6f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-778132456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8501cc-a1e6-4711-8098-b7b719889955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a71b25b53f423b814223fb1d82811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:56Z,use_quota=True,user_id='a1b52757854648c0b81d38edc7744444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9e8185-466a-4680-8f1a-2057bbbf08a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9e8185-466a-4680-8f1a-2057bbbf08a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46381399-a0c1-49ec-a4be-44e54e326374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46381399-a0c1-49ec-a4be-44e54e326374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc8501cc-a1e6-4711-8098-b7b719889955', 'volume_name': 'volume-bc8501cc-a1e6-4711-8098-b7b719889955', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7053480-694e-47e0-ba55-4c7df44818e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7053480-694e-47e0-ba55-4c7df44818e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e285662-0990-492d-bde4-3b8f3824129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:55 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Volume bc8501cc-a1e6-4711-8098-b7b719889955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc8501cc-a1e6-4711-8098-b7b719889955', 'volume_size': 1}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-778132456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8501cc-a1e6-4711-8098-b7b719889955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a71b25b53f423b814223fb1d82811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:46:56Z,use_quota=True,user_id='a1b52757854648c0b81d38edc7744444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Creating volume bc8501cc-a1e6-4711-8098-b7b719889955 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:46:55 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:46:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:55 devstack sudo[87432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955 1073741824
Apr 24 14:46:55 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:56 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629" returned: 0 in 0.646s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:56 devstack sudo[87434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629
Apr 24 14:46:56 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:56 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19" returned: 0 in 0.801s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19" released by "delete_volume" :: held 1.693s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created reservations ['ae92431d-1541-4227-8207-786f153bd117', '9b0bf8e3-79d9-4756-a702-eec9e6b4d97b', '1c6e1852-c93f-4b23-aa55-450817269a3a', '6c94c615-a07c-4405-b2aa-457a59fb526f'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:56 devstack sudo[87440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:56 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:56 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-66807284-b695-418f-a136-935cec8e8629" returned: 0 in 0.769s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Lock "cinder-quobyte-66807284-b695-418f-a136-935cec8e8629" released by "delete_volume" :: held 1.471s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Created reservations ['c879b60e-7983-4124-89b1-d0866ae193ec', '033c176c-a91c-408d-890a-3eead3b07af1', 'b53a4091-e23d-42bb-af9e-6d9d59864157', 'e64bb984-da2c-4870-a7cb-2de45d1eef03'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-48f52fee-9cb1-4837-bd60-cfd4c6110062-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:56 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955 1073741824" returned: 0 in 1.086s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-48f52fee-9cb1-4837-bd60-cfd4c6110062-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-quobyte-48f52fee-9cb1-4837-bd60-cfd4c6110062" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-48f52fee-9cb1-4837-bd60-cfd4c6110062" acquired by "delete_volume" :: waited 0.061s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:57 devstack sudo[87443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955
Apr 24 14:46:57 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8baf0ea-b652-45a9-9ba1-33f84d01110b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:57 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:57 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:57 devstack sudo[87445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062
Apr 24 14:46:57 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:57 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.946s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:57 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Deleted volume successfully.
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c6c4be5d-0222-4c74-9faa-753aa2346fe1 tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-8aa18b8d-33bc-4cb9-85a8-a3bf1a7bbf19-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:57 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.777s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:57 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:58 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Deleted volume successfully.
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b4895d4-84cf-4271-a20f-d2d356b8e2bc tempest-VolumeQuotasAdminTestJSON-200580500 None] Lock "cinder-66807284-b695-418f-a136-935cec8e8629-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:58 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062" returned: 0 in 0.935s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:58 devstack sudo[87455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062
Apr 24 14:46:58 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:58 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955" returned: 0 in 1.237s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] <== create_volume: return (2423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.426s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e285662-0990-492d-bde4-3b8f3824129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc8501cc-a1e6-4711-8098-b7b719889955', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a8c6dc-b593-499c-baaf-478124e2ae57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:46:58 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Volume volume-bc8501cc-a1e6-4711-8098-b7b719889955 (bc8501cc-a1e6-4711-8098-b7b719889955): created successfully
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a8c6dc-b593-499c-baaf-478124e2ae57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Flow 'volume_create_manager' (76409709-2688-4284-af3e-99d5b8d648a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:46:58 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e767e5f9-f802-4298-b215-260d3b8ac2c2 tempest-VolumesTransfersTest-1739853637 None] Created volume successfully.
Apr 24 14:46:58 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-48f52fee-9cb1-4837-bd60-cfd4c6110062" returned: 0 in 0.619s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-48f52fee-9cb1-4837-bd60-cfd4c6110062" released by "delete_volume" :: held 1.630s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created reservations ['67dbaa7f-e1cc-422a-9f5d-a26b26da4be1', 'e6f85b41-876c-44b1-aef9-7a5d1d3ef299', '992e0149-5a4f-4b9e-a73e-5472163d5de7', '70e1dd7f-31ae-4be6-9d19-f148d206b4e8'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:46:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:59 devstack sudo[87458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:46:59 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-3085f0dd-9268-428b-9c0e-f445b68177bc-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-3085f0dd-9268-428b-9c0e-f445b68177bc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "cinder-quobyte-3085f0dd-9268-428b-9c0e-f445b68177bc" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-3085f0dd-9268-428b-9c0e-f445b68177bc" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f8f852-4d4c-4d16-be51-75bdfd4eb84b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:59 devstack sudo[87460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc
Apr 24 14:46:59 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Acquiring lock "cinder-bc8501cc-a1e6-4711-8098-b7b719889955-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Lock "cinder-bc8501cc-a1e6-4711-8098-b7b719889955-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Acquiring lock "cinder-quobyte-bc8501cc-a1e6-4711-8098-b7b719889955" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Lock "cinder-quobyte-bc8501cc-a1e6-4711-8098-b7b719889955" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:46:59 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b4848-ce6e-46e6-b3fe-18ddb8c10a50]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.849s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:46:59 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Deleted volume successfully.
Apr 24 14:46:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d9584ffa-2db6-46f7-bcfd-df038176cb7c tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-48f52fee-9cb1-4837-bd60-cfd4c6110062-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:00 devstack sudo[87463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955
Apr 24 14:47:00 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Flow 'volume_create_manager' (9ed30af3-51c0-495b-acd6-b91d41a2a4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0d019a-790c-4ab5-b54f-a5633d7fc2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0d019a-790c-4ab5-b54f-a5633d7fc2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-823384547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b958973c-9167-4929-adfe-76f17c6199aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878d717a2ea64f208a83ff94f7dc6617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:00Z,use_quota=True,user_id='37465f7d1a534e7397e308cfb82c6a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec50101a-8a23-44ce-a01a-f94f89c63de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec50101a-8a23-44ce-a01a-f94f89c63de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa5381e-2bb3-461f-87e5-1111c21b14c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa5381e-2bb3-461f-87e5-1111c21b14c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b958973c-9167-4929-adfe-76f17c6199aa', 'volume_name': 'volume-b958973c-9167-4929-adfe-76f17c6199aa', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dc7314-6217-467e-a81c-4fbeb3966f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dc7314-6217-467e-a81c-4fbeb3966f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0889d17a-35f5-4bbf-8f2c-496cfc3a8385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Volume b958973c-9167-4929-adfe-76f17c6199aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b958973c-9167-4929-adfe-76f17c6199aa', 'volume_size': 1}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-823384547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b958973c-9167-4929-adfe-76f17c6199aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878d717a2ea64f208a83ff94f7dc6617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:00Z,use_quota=True,user_id='37465f7d1a534e7397e308cfb82c6a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Creating volume b958973c-9167-4929-adfe-76f17c6199aa {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:47:00 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:00 devstack sudo[87465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa 1073741824
Apr 24 14:47:00 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:00 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc" returned: 0 in 0.975s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:00 devstack sudo[87470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc
Apr 24 14:47:00 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:00 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955" returned: 0 in 0.773s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:00 devstack sudo[87475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955
Apr 24 14:47:00 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:01 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-3085f0dd-9268-428b-9c0e-f445b68177bc" returned: 0 in 0.588s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-quobyte-3085f0dd-9268-428b-9c0e-f445b68177bc" released by "delete_volume" :: held 1.617s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:01 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa 1073741824" returned: 0 in 0.834s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:01 devstack sudo[87482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa
Apr 24 14:47:01 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Created reservations ['79bbe6ba-9b3e-4aa5-aa7c-4962f65b9311', 'c2329c4b-35f9-41e0-9ee2-1698aaf1b64b', '7a119b74-505a-4826-9787-af27c74eb684', '98ef11a2-02b5-4aa4-a0f1-158f3d30fd58'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:47:01 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bc8501cc-a1e6-4711-8098-b7b719889955" returned: 0 in 0.673s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Lock "cinder-quobyte-bc8501cc-a1e6-4711-8098-b7b719889955" released by "delete_volume" :: held 1.519s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:01 devstack sudo[87484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:47:01 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Created reservations ['fe782084-f16b-44fd-9f96-0401485a947f', '2dcb5432-4869-4ae0-be0f-b9128505f3fb', 'e6744630-5cfd-4c25-adb2-6282d77bd896', '3dab1f6b-f036-42dc-8f9f-2a535ba9d8d4'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:01 devstack sudo[87486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:47:01 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:01 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa" returned: 0 in 0.520s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0889d17a-35f5-4bbf-8f2c-496cfc3a8385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b958973c-9167-4929-adfe-76f17c6199aa', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6069445b-bb14-4e91-a1ce-b239569a9856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:01 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Volume volume-b958973c-9167-4929-adfe-76f17c6199aa (b958973c-9167-4929-adfe-76f17c6199aa): created successfully
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6069445b-bb14-4e91-a1ce-b239569a9856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Flow 'volume_create_manager' (9ed30af3-51c0-495b-acd6-b91d41a2a4c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:01 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-abfecc9f-4b60-49eb-aa31-137a944ac321 tempest-VolumesSnapshotTestJSON-553295167 None] Created volume successfully.
Apr 24 14:47:01 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.625s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:47:01 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Deleted volume successfully.
Apr 24 14:47:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8af13dfa-80f6-47dc-92df-6e96f94da01d tempest-CreateVolumesFromSourceVolumeTest-470185078 None] Lock "cinder-3085f0dd-9268-428b-9c0e-f445b68177bc-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:02 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.638s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:02 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:47:02 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Deleted volume successfully.
Apr 24 14:47:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-21cdf74d-9036-4f85-bfc0-dc2f218e6a6d tempest-VolumesTransfersTest-1579148521 None] Lock "cinder-bc8501cc-a1e6-4711-8098-b7b719889955-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] Creating offline snapshot bcb674a1-3418-4280-bd36-43122501339d of volume b958973c-9167-4929-adfe-76f17c6199aa {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:47:02 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e9483c-93ad-47c2-b2aa-929c7d200ab8]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:02 devstack sudo[87492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa
Apr 24 14:47:02 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:03 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa" returned: 0 in 0.844s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:03 devstack sudo[87498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d 1G
Apr 24 14:47:03 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:04 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d 1G" returned: 0 in 0.846s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b958973c-9167-4929-adfe-76f17c6199aa -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:04 devstack sudo[87503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b958973c-9167-4929-adfe-76f17c6199aa -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d
Apr 24 14:47:04 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:05 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b958973c-9167-4929-adfe-76f17c6199aa -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d" returned: 0 in 0.788s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:05 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d is being set with open permissions: ugo+rw
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:05 devstack sudo[87508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d
Apr 24 14:47:05 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Flow 'volume_create_manager' (7556b604-0626-4a39-8ee9-b519ddd24e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78018954-fa2f-49b0-b711-92fce4c8d98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78018954-fa2f-49b0-b711-92fce4c8d98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a2b904-ea7e-45f4-b31f-ff3e6a89bff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4a74f5dcb44448ba9ab5b466c6de3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:06Z,use_quota=True,user_id='bd1d47dc29b9458594341419f43ebf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eebd8a2-1ea2-4fa9-83a4-d21b75d33e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eebd8a2-1ea2-4fa9-83a4-d21b75d33e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e79aace-83df-4c9a-8cee-a5df045577a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e79aace-83df-4c9a-8cee-a5df045577a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a2b904-ea7e-45f4-b31f-ff3e6a89bff4', 'volume_name': 'volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3bfd6b-842f-4e5f-bf21-c3c968a63d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3bfd6b-842f-4e5f-bf21-c3c968a63d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9514a557-46d7-409a-92f7-357048d11f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:05 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Volume 11a2b904-ea7e-45f4-b31f-ff3e6a89bff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4', 'volume_size': 1}
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:05 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d" returned: 0 in 0.692s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:06 devstack sudo[87511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.info
Apr 24 14:47:06 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:06 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.info" returned: 0 in 0.598s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:06 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.info is being set with open permissions: ugo+rw
Apr 24 14:47:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:06 devstack sudo[87514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.info
Apr 24 14:47:06 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:07 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.info" returned: 0 in 0.576s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.465s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.339s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a2b904-ea7e-45f4-b31f-ff3e6a89bff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4a74f5dcb44448ba9ab5b466c6de3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:06Z,use_quota=True,user_id='bd1d47dc29b9458594341419f43ebf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Creating volume 11a2b904-ea7e-45f4-b31f-ff3e6a89bff4 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:47:07 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:47:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:07 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4 1073741824
Apr 24 14:47:07 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:07 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c2aef51b-a8fe-41b7-9bcc-12be18bc2e30 tempest-VolumesSnapshotTestJSON-553295167 None] Create snapshot completed successfully
Apr 24 14:47:08 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4 1073741824" returned: 0 in 0.869s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-bcb674a1-3418-4280-bd36-43122501339d-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:08 devstack sudo[87522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4
Apr 24 14:47:08 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-bcb674a1-3418-4280-bd36-43122501339d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-b958973c-9167-4929-adfe-76f17c6199aa" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-b958973c-9167-4929-adfe-76f17c6199aa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-bcb674a1-3418-4280-bd36-43122501339d" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-bcb674a1-3418-4280-bd36-43122501339d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Deleting offline snapshot bcb674a1-3418-4280-bd36-43122501339d of volume b958973c-9167-4929-adfe-76f17c6199aa {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] snapshot_file for this snap is: volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[442dcc01-2fec-4a71-8724-18aacb27db68]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:08 devstack sudo[87524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d
Apr 24 14:47:08 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:08 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4" returned: 0 in 0.585s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9514a557-46d7-409a-92f7-357048d11f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a83315d-3478-41c2-b593-4a847b97604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:08 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Volume volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4 (11a2b904-ea7e-45f4-b31f-ff3e6a89bff4): created successfully
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a83315d-3478-41c2-b593-4a847b97604e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Flow 'volume_create_manager' (7556b604-0626-4a39-8ee9-b519ddd24e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:08 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-69c0ed56-3704-49bf-81ce-e26ca6ee6167 tempest-CinderUnicodeTest-870909184 None] Created volume successfully.
Apr 24 14:47:09 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d" returned: 0 in 0.743s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b958973c-9167-4929-adfe-76f17c6199aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[042a2b01-dda8-4187-92d1-b003cccac20c]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:09 devstack sudo[87530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa
Apr 24 14:47:09 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Flow 'volume_create_manager' (a434d8c1-eb88-417e-9b2c-2dd4f3ecac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc354bf-ed01-4cc7-b4e1-9f81b16fb9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc354bf-ed01-4cc7-b4e1-9f81b16fb9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-273057201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9297ea-8798-4a3c-877b-2d808d3bb113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4a74f5dcb44448ba9ab5b466c6de3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:10Z,use_quota=True,user_id='bd1d47dc29b9458594341419f43ebf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5792c5ca-7f2b-4acc-adb5-e85d8a7a12d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5792c5ca-7f2b-4acc-adb5-e85d8a7a12d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d21f38-4c77-41db-a717-204d5e43f876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d21f38-4c77-41db-a717-204d5e43f876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e9297ea-8798-4a3c-877b-2d808d3bb113', 'volume_name': 'volume-7e9297ea-8798-4a3c-877b-2d808d3bb113', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dcb55a-75d6-4255-95c6-896a21534add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dcb55a-75d6-4255-95c6-896a21534add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90778983-c5fc-45eb-ac85-d1c1ec53b390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:09 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Volume 7e9297ea-8798-4a3c-877b-2d808d3bb113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e9297ea-8798-4a3c-877b-2d808d3bb113', 'volume_size': 1}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-273057201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9297ea-8798-4a3c-877b-2d808d3bb113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4a74f5dcb44448ba9ab5b466c6de3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:10Z,use_quota=True,user_id='bd1d47dc29b9458594341419f43ebf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Creating volume 7e9297ea-8798-4a3c-877b-2d808d3bb113 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:47:09 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:09 devstack sudo[87532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 1073741824
Apr 24 14:47:09 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:09 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa" returned: 0 in 0.728s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:09 devstack sudo[87537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d
Apr 24 14:47:09 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:10 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 1073741824" returned: 0 in 0.816s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:10 devstack sudo[87545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113
Apr 24 14:47:10 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:10 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d" returned: 0 in 0.906s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:10 devstack sudo[87547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d
Apr 24 14:47:10 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:11 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113" returned: 0 in 0.754s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90778983-c5fc-45eb-ac85-d1c1ec53b390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9297ea-8798-4a3c-877b-2d808d3bb113', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff6a91f-b06c-4752-bb3d-a0729da1f7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:11 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:11 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Volume volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 (7e9297ea-8798-4a3c-877b-2d808d3bb113): created successfully
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff6a91f-b06c-4752-bb3d-a0729da1f7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Flow 'volume_create_manager' (a434d8c1-eb88-417e-9b2c-2dd4f3ecac20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa.bcb674a1-3418-4280-bd36-43122501339d" returned: 0 in 0.594s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-32ffdeb9-5510-42da-80a6-ab78c3797430 tempest-CinderUnicodeTest-870909184 None] Created volume successfully.
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-bcb674a1-3418-4280-bd36-43122501339d" released by "_delete_snapshot" :: held 3.109s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-b958973c-9167-4929-adfe-76f17c6199aa" released by "delete_snapshot" :: held 3.147s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Created reservations ['5bde8ff2-9562-4e56-a83b-4c4c408e4e6b', '4db7acbc-937d-45d9-ba7a-84c421ec69f7', '0b8e8284-f478-4f51-aa93-8b1e01b10f61', '98875c54-338f-4c02-93a4-0fecdc8e0310'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:47:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Delete snapshot completed successfully.
Apr 24 14:47:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-44e7e6de-de68-44eb-ad5d-25e21888352d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-bcb674a1-3418-4280-bd36-43122501339d-delete_snapshot" released by "delete_snapshot" :: held 3.340s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] Creating offline snapshot 10d11617-ac50-4ba9-9ba8-a015fad87455 of volume 7e9297ea-8798-4a3c-877b-2d808d3bb113 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:47:12 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[280606c7-8740-47d6-a4bd-d68c0b8a70ef]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:12 devstack sudo[87551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113
Apr 24 14:47:12 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:12 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113" returned: 0 in 0.700s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:12 devstack sudo[87557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455 1G
Apr 24 14:47:12 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Flow 'volume_create_manager' (893a3cd2-50a7-4b23-b2f3-28b989de7355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18988f21-557d-4338-a115-e82ef8fa3dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18988f21-557d-4338-a115-e82ef8fa3dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1795589982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795ac843-4fbd-4523-b20a-a50f9c95e307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878d717a2ea64f208a83ff94f7dc6617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:13Z,use_quota=True,user_id='37465f7d1a534e7397e308cfb82c6a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf4ac30-c085-434a-a4c4-a78715ae9c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf4ac30-c085-434a-a4c4-a78715ae9c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ef9ed6-60ef-4226-b8f4-ec7d49d8570b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ef9ed6-60ef-4226-b8f4-ec7d49d8570b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795ac843-4fbd-4523-b20a-a50f9c95e307', 'volume_name': 'volume-795ac843-4fbd-4523-b20a-a50f9c95e307', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e8a2d6-c225-408e-944a-584f4d5f88fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e8a2d6-c225-408e-944a-584f4d5f88fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98a8572-f3d3-4fc3-84d4-41d0e5783ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:13 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Volume 795ac843-4fbd-4523-b20a-a50f9c95e307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795ac843-4fbd-4523-b20a-a50f9c95e307', 'volume_size': 1}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:13 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455 1G" returned: 0 in 0.794s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:13 devstack sudo[87562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455
Apr 24 14:47:13 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:14 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455" returned: 0 in 0.720s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:14 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455 is being set with open permissions: ugo+rw
Apr 24 14:47:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:14 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455
Apr 24 14:47:14 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:14 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455" returned: 0 in 0.555s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:14 devstack sudo[87570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.info
Apr 24 14:47:14 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:15 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.info" returned: 0 in 0.501s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:15 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.info is being set with open permissions: ugo+rw
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:15 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.info
Apr 24 14:47:15 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:15 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.info" returned: 0 in 0.563s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.946s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.637s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1795589982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795ac843-4fbd-4523-b20a-a50f9c95e307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878d717a2ea64f208a83ff94f7dc6617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:13Z,use_quota=True,user_id='37465f7d1a534e7397e308cfb82c6a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Creating volume 795ac843-4fbd-4523-b20a-a50f9c95e307 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:47:15 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:47:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:16 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c9ca0b36-b1c4-4a5d-b82b-a6f7f9602e4a tempest-CinderUnicodeTest-870909184 None] Create snapshot completed successfully
Apr 24 14:47:16 devstack sudo[87576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 1073741824
Apr 24 14:47:16 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Acquiring lock "cinder-10d11617-ac50-4ba9-9ba8-a015fad87455-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Lock "cinder-10d11617-ac50-4ba9-9ba8-a015fad87455-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Acquiring lock "cinder-quobyte-7e9297ea-8798-4a3c-877b-2d808d3bb113" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Lock "cinder-quobyte-7e9297ea-8798-4a3c-877b-2d808d3bb113" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Acquiring lock "cinder-quobyte-10d11617-ac50-4ba9-9ba8-a015fad87455" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Lock "cinder-quobyte-10d11617-ac50-4ba9-9ba8-a015fad87455" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Deleting offline snapshot 10d11617-ac50-4ba9-9ba8-a015fad87455 of volume 7e9297ea-8798-4a3c-877b-2d808d3bb113 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] snapshot_file for this snap is: volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[52160006-204b-4c96-86a7-c4eaff80c19f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:16 devstack sudo[87578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455
Apr 24 14:47:16 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:16 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 1073741824" returned: 0 in 0.744s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:16 devstack sudo[87583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307
Apr 24 14:47:16 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:17 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455" returned: 0 in 0.701s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e9297ea-8798-4a3c-877b-2d808d3bb113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[7214b8d9-3803-4c54-835f-a19f1d48258a]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:17 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307" returned: 0 in 0.514s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98a8572-f3d3-4fc3-84d4-41d0e5783ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795ac843-4fbd-4523-b20a-a50f9c95e307', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:17 devstack sudo[87588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113
Apr 24 14:47:17 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbcf232-bb1b-4492-baf0-b227ecd40c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:17 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Volume volume-795ac843-4fbd-4523-b20a-a50f9c95e307 (795ac843-4fbd-4523-b20a-a50f9c95e307): created successfully
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbcf232-bb1b-4492-baf0-b227ecd40c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Flow 'volume_create_manager' (893a3cd2-50a7-4b23-b2f3-28b989de7355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:17 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d6daeba3-01e8-47e9-8b79-9c8f2f203807 tempest-VolumesSnapshotTestJSON-553295167 None] Created volume successfully.
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] Creating offline snapshot 4c5915ce-eed9-4b50-9382-35cc0a4ff623 of volume 795ac843-4fbd-4523-b20a-a50f9c95e307 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14aa822-befd-4f41-99f7-55d1720e1830]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:17 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:17 devstack sudo[87592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307
Apr 24 14:47:17 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113" returned: 0 in 0.819s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:17 devstack sudo[87596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455
Apr 24 14:47:17 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:18 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307" returned: 0 in 0.771s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:18 devstack sudo[87604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623 1G
Apr 24 14:47:18 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:18 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455" returned: 0 in 0.975s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:18 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455
Apr 24 14:47:18 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:19 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623 1G" returned: 0 in 0.914s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-795ac843-4fbd-4523-b20a-a50f9c95e307 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:19 devstack sudo[87612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-795ac843-4fbd-4523-b20a-a50f9c95e307 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623
Apr 24 14:47:19 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:19 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113.10d11617-ac50-4ba9-9ba8-a015fad87455" returned: 0 in 0.685s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Lock "cinder-quobyte-10d11617-ac50-4ba9-9ba8-a015fad87455" released by "_delete_snapshot" :: held 3.295s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Lock "cinder-quobyte-7e9297ea-8798-4a3c-877b-2d808d3bb113" released by "delete_snapshot" :: held 3.332s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Created reservations ['18e2c82f-1e53-4ed5-a213-83348648babf', 'f9fd3856-8d5c-4b0c-8af7-5d7038fd1a49', '895c0200-8d74-40e1-9019-a8978d8ea0f5', '72f9f117-36ac-4f2b-b048-183fae982dc8'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Flow 'volume_create_manager' (90357cd4-eca8-4b73-9741-5ec1af894baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7486763c-e74a-4a93-9f70-4845600ab6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7486763c-e74a-4a93-9f70-4845600ab6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-482098039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ced2ca-43e6-4167-883b-5b00ef666e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016559b6db52408a8cc22c311a82d680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:20Z,use_quota=True,user_id='2fe0eb3503324b49b40be6ee54423dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c184474-7b0a-4f39-b9b3-9536bf42ed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c184474-7b0a-4f39-b9b3-9536bf42ed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ecbf5c-fd04-4f7d-97b7-9a5b1e647f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ecbf5c-fd04-4f7d-97b7-9a5b1e647f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ced2ca-43e6-4167-883b-5b00ef666e8d', 'volume_name': 'volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6fcb06-0f08-4157-abf0-03b206f9518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6fcb06-0f08-4157-abf0-03b206f9518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f6a671-ffe1-4e43-b9e8-8a9659d5783c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:19 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Volume d8ced2ca-43e6-4167-883b-5b00ef666e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d', 'volume_size': 1}
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Delete snapshot completed successfully.
Apr 24 14:47:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20f91128-ec7f-4abf-8701-ae869cfd3bcf tempest-CinderUnicodeTest-870909184 None] Lock "cinder-10d11617-ac50-4ba9-9ba8-a015fad87455-delete_snapshot" released by "delete_snapshot" :: held 3.599s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:20 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-795ac843-4fbd-4523-b20a-a50f9c95e307 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623" returned: 0 in 0.780s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:20 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623 is being set with open permissions: ugo+rw
Apr 24 14:47:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:20 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623
Apr 24 14:47:20 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Acquiring lock "cinder-7e9297ea-8798-4a3c-877b-2d808d3bb113-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Lock "cinder-7e9297ea-8798-4a3c-877b-2d808d3bb113-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Acquiring lock "cinder-quobyte-7e9297ea-8798-4a3c-877b-2d808d3bb113" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Lock "cinder-quobyte-7e9297ea-8798-4a3c-877b-2d808d3bb113" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:20 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623" returned: 0 in 0.570s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:20 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[73549c8d-596f-46e4-abd0-12558fea381d]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:20 devstack sudo[87621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.info
Apr 24 14:47:20 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:20 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113
Apr 24 14:47:20 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:21 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.info" returned: 0 in 0.508s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:21 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.info is being set with open permissions: ugo+rw
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:21 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.info
Apr 24 14:47:21 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:21 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113" returned: 0 in 0.673s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:21 devstack sudo[87630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113
Apr 24 14:47:21 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:21 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.info" returned: 0 in 0.452s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.132s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-482098039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ced2ca-43e6-4167-883b-5b00ef666e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016559b6db52408a8cc22c311a82d680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:20Z,use_quota=True,user_id='2fe0eb3503324b49b40be6ee54423dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Creating volume d8ced2ca-43e6-4167-883b-5b00ef666e8d {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:47:21 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:47:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:21 devstack sudo[87633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d 1073741824
Apr 24 14:47:21 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:21 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4b9336d5-03e2-410c-aecc-64d1e8e45474 tempest-VolumesSnapshotTestJSON-553295167 None] Create snapshot completed successfully
Apr 24 14:47:22 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7e9297ea-8798-4a3c-877b-2d808d3bb113" returned: 0 in 0.521s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Lock "cinder-quobyte-7e9297ea-8798-4a3c-877b-2d808d3bb113" released by "delete_volume" :: held 1.275s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Created reservations ['a9f6b73d-d406-4429-8e7c-0fedc62cbcf1', 'ec338b90-593a-43ad-b994-c8338331d573', '017546d5-5cf2-45bf-a264-a607a3c2f4ef', '97448542-2d14-48d3-b116-66321b4d6f9b'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:22 devstack sudo[87636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:47:22 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:22 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d 1073741824" returned: 0 in 0.749s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:22 devstack sudo[87643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d
Apr 24 14:47:22 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:22 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.543s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:47:22 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Deleted volume successfully.
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-61490051-66d7-4729-884a-61ccf974a279 tempest-CinderUnicodeTest-870909184 None] Lock "cinder-7e9297ea-8798-4a3c-877b-2d808d3bb113-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Acquiring lock "cinder-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Lock "cinder-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Acquiring lock "cinder-quobyte-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Lock "cinder-quobyte-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e532857-8c8a-4f84-a453-112b6145ef91]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:23 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d" returned: 0 in 0.668s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:23 devstack sudo[87677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4
Apr 24 14:47:23 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f6a671-ffe1-4e43-b9e8-8a9659d5783c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8d30f4-d875-4ff5-a214-c3be423d1df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:23 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Volume volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d (d8ced2ca-43e6-4167-883b-5b00ef666e8d): created successfully
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8d30f4-d875-4ff5-a214-c3be423d1df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Flow 'volume_create_manager' (90357cd4-eca8-4b73-9741-5ec1af894baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:23 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-674e23f4-fa05-4c53-8787-ab41e5fc5e7b tempest-VolumesActionsTest-1580478361 None] Created volume successfully.
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Flow 'volume_create_manager' (c0a3eb5a-2f4b-4cc2-bd6f-5fcbd5299991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f5f932-c59d-4bde-869e-6b678d510860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f5f932-c59d-4bde-869e-6b678d510860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-319006417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd059a3-2967-4de4-8124-22fc4f6d00fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878d717a2ea64f208a83ff94f7dc6617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4c5915ce-eed9-4b50-9382-35cc0a4ff623,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:23Z,use_quota=True,user_id='37465f7d1a534e7397e308cfb82c6a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee47442b-0ed3-4d96-85af-f9c369a123cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee47442b-0ed3-4d96-85af-f9c369a123cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a917098b-d504-4a03-8df3-00d8d37077f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a917098b-d504-4a03-8df3-00d8d37077f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bdd059a3-2967-4de4-8124-22fc4f6d00fc', 'volume_name': 'volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc', 'volume_size': 2, 'snapshot_id': '4c5915ce-eed9-4b50-9382-35cc0a4ff623'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50dba5c-fefd-459d-bf0e-ef5a720c57cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50dba5c-fefd-459d-bf0e-ef5a720c57cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8868dfc0-6ab9-45d2-8a1d-345c7cfcbbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:23 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Volume bdd059a3-2967-4de4-8124-22fc4f6d00fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc', 'volume_size': 2, 'snapshot_id': '4c5915ce-eed9-4b50-9382-35cc0a4ff623'}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-4c5915ce-eed9-4b50-9382-35cc0a4ff623-bdd059a3-2967-4de4-8124-22fc4f6d00fc" by "_create_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-4c5915ce-eed9-4b50-9382-35cc0a4ff623-bdd059a3-2967-4de4-8124-22fc4f6d00fc" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Creating volume bdd059a3-2967-4de4-8124-22fc4f6d00fc from snapshot 4c5915ce-eed9-4b50-9382-35cc0a4ff623 {{(pid=81510) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-bdd059a3-2967-4de4-8124-22fc4f6d00fc" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-bdd059a3-2967-4de4-8124-22fc4f6d00fc" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] snapshot: 4c5915ce-eed9-4b50-9382-35cc0a4ff623, volume: bdd059a3-2967-4de4-8124-22fc4f6d00fc,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb1829e-605e-4dc9-a24f-d611bbf6316e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:23 devstack sudo[87682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623
Apr 24 14:47:23 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:24 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4" returned: 0 in 0.921s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:24 devstack sudo[87687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4
Apr 24 14:47:24 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:24 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623" returned: 0 in 0.816s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-795ac843-4fbd-4523-b20a-a50f9c95e307(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[192e9d58-7339-41df-9cd0-2a46897031a1]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:24 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4" returned: 0 in 0.635s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Lock "cinder-quobyte-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4" released by "delete_volume" :: held 1.635s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:24 devstack sudo[87693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307
Apr 24 14:47:24 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Created reservations ['a6027b7d-0bbb-4a03-b662-28470e7f44a7', '2baef03c-9d32-4c59-8493-2290719149c2', '79bdc09d-f59f-49ec-a660-1a90403d2f31', '2ef7dbe8-9224-4e34-92b0-89c042bd1a5a'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:24 devstack sudo[87695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:47:24 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:25 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307" returned: 0 in 0.689s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:25 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:47:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:25 devstack sudo[87702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc
Apr 24 14:47:25 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:25 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.783s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:25 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:47:25 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Deleted volume successfully.
Apr 24 14:47:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-276247c7-6c13-4e59-a83a-c94adddb7c5a tempest-CinderUnicodeTest-870909184 None] Lock "cinder-11a2b904-ea7e-45f4-b31f-ff3e6a89bff4-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:32 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc" returned: 0 in 7.029s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:32 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4afdf24-9fad-4aa4-b6f3-ce78f900af9b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:32 devstack sudo[87717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307
Apr 24 14:47:32 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:33 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307" returned: 0 in 0.826s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:33 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307, size 1024.00 MB, duration 7.03 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:47:33 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Converted 1024.00 MB image at 145.66 MB/s
Apr 24 14:47:33 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc is being set with open permissions: ugo+rw
Apr 24 14:47:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:33 devstack sudo[87722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc
Apr 24 14:47:33 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:33 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc" returned: 0 in 0.692s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-bdd059a3-2967-4de4-8124-22fc4f6d00fc" released by "_copy_volume_from_snapshot" :: held 10.155s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-4c5915ce-eed9-4b50-9382-35cc0a4ff623-bdd059a3-2967-4de4-8124-22fc4f6d00fc" released by "_create_volume_from_snapshot" :: held 10.190s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.204s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8868dfc0-6ab9-45d2-8a1d-345c7cfcbbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc', 'volume_size': 2, 'snapshot_id': '4c5915ce-eed9-4b50-9382-35cc0a4ff623'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbac5c92-4fa3-46b7-b22f-6d0967960b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:33 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Volume volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc (bdd059a3-2967-4de4-8124-22fc4f6d00fc): created successfully
Apr 24 14:47:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbac5c92-4fa3-46b7-b22f-6d0967960b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Flow 'volume_create_manager' (c0a3eb5a-2f4b-4cc2-bd6f-5fcbd5299991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:34 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1811e2d5-01ed-4bd6-af3c-432bb5603be5 tempest-VolumesSnapshotTestJSON-553295167 None] Created volume successfully.
Apr 24 14:47:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-bdd059a3-2967-4de4-8124-22fc4f6d00fc-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-bdd059a3-2967-4de4-8124-22fc4f6d00fc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-bdd059a3-2967-4de4-8124-22fc4f6d00fc" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-bdd059a3-2967-4de4-8124-22fc4f6d00fc" acquired by "delete_volume" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:35 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e30c100-1804-4cdf-9855-cec25548f581]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:35 devstack sudo[87742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc
Apr 24 14:47:35 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:35 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc" returned: 0 in 0.629s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:35 devstack sudo[87747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc
Apr 24 14:47:35 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:36 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bdd059a3-2967-4de4-8124-22fc4f6d00fc" returned: 0 in 0.507s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-bdd059a3-2967-4de4-8124-22fc4f6d00fc" released by "delete_volume" :: held 1.226s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Created reservations ['2c09a319-a7a0-45c7-b260-0933fb266b35', 'fe246631-2794-408c-aec1-211d859b5c60', '968ea4e7-9600-48d2-9e5b-f9b714d82f51', 'f076693b-ed1d-4312-9bb2-378d316f8c23'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:36 devstack sudo[87750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:47:36 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:36 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.503s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:47:36 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Deleted volume successfully.
Apr 24 14:47:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-19189965-63a5-45c0-8fc4-40b42a127c96 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-bdd059a3-2967-4de4-8124-22fc4f6d00fc-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-4c5915ce-eed9-4b50-9382-35cc0a4ff623-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-4c5915ce-eed9-4b50-9382-35cc0a4ff623-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-795ac843-4fbd-4523-b20a-a50f9c95e307" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-795ac843-4fbd-4523-b20a-a50f9c95e307" acquired by "delete_snapshot" :: waited 0.051s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-4c5915ce-eed9-4b50-9382-35cc0a4ff623" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-4c5915ce-eed9-4b50-9382-35cc0a4ff623" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Deleting offline snapshot 4c5915ce-eed9-4b50-9382-35cc0a4ff623 of volume 795ac843-4fbd-4523-b20a-a50f9c95e307 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] snapshot_file for this snap is: volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[713c38b5-d5b4-4dc7-b9b9-ca7f522e776e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:37 devstack sudo[87758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623
Apr 24 14:47:37 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:37 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623" returned: 0 in 0.533s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-795ac843-4fbd-4523-b20a-a50f9c95e307(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9eb939-609c-4771-892b-019977e33980]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:37 devstack sudo[87763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307
Apr 24 14:47:37 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:38 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307" returned: 0 in 0.549s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:38 devstack sudo[87768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623
Apr 24 14:47:38 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:39 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623" returned: 0 in 0.589s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:39 devstack sudo[87776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623
Apr 24 14:47:39 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:39 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307.4c5915ce-eed9-4b50-9382-35cc0a4ff623" returned: 0 in 0.438s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-4c5915ce-eed9-4b50-9382-35cc0a4ff623" released by "_delete_snapshot" :: held 2.220s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-795ac843-4fbd-4523-b20a-a50f9c95e307" released by "delete_snapshot" :: held 2.247s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:39 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Created reservations ['480f9866-d734-4035-9e3e-5ac7435f4343', 'e7301978-49d6-415f-a97b-2e83d88380a3', '2001c680-99b7-4cc6-935b-ad832bde77bc', '1c6bd947-7c3a-4572-abb5-a0bc4edd1799'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:47:39 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Delete snapshot completed successfully.
Apr 24 14:47:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-54700c47-00f4-432b-a27f-1eb91d47d625 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-4c5915ce-eed9-4b50-9382-35cc0a4ff623-delete_snapshot" released by "delete_snapshot" :: held 2.409s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-795ac843-4fbd-4523-b20a-a50f9c95e307-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-795ac843-4fbd-4523-b20a-a50f9c95e307-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-795ac843-4fbd-4523-b20a-a50f9c95e307" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-795ac843-4fbd-4523-b20a-a50f9c95e307" acquired by "delete_volume" :: waited 0.044s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:40 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea76ac3e-8b40-486d-87df-4c2ae111e4f1]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:40 devstack sudo[87820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307
Apr 24 14:47:40 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:41 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307" returned: 0 in 0.795s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:41 devstack sudo[87826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307
Apr 24 14:47:41 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:42 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-795ac843-4fbd-4523-b20a-a50f9c95e307" returned: 0 in 0.744s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-795ac843-4fbd-4523-b20a-a50f9c95e307" released by "delete_volume" :: held 1.667s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:42 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:UPDATE=185,cinder:SELECT=148,cinder:INSERT=46,cinder:DELETE=16 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:47:42 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Created reservations ['4b143f74-754d-4713-b17d-f83250303f14', '8366388a-3741-42ab-a864-451983649f9e', '5cd682f1-300e-41ca-a49b-4abe323f2e2e', '627cd92b-0965-4ef3-b84d-6643719a6213'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:47:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:42 devstack sudo[87830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:47:42 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0f31c611-a68d-425e-bde6-4d233457dfd2 tempest-VolumesActionsTest-1580478361 None] Acquiring lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d" by "attach_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0f31c611-a68d-425e-bde6-4d233457dfd2 tempest-VolumesActionsTest-1580478361 None] Lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d" acquired by "attach_volume" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=128,cinder:INSERT=46,cinder:UPDATE=181,cinder:DELETE=16 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:43 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:47:43 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:43 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.917s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:47:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Deleted volume successfully.
Apr 24 14:47:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-0f31c611-a68d-425e-bde6-4d233457dfd2 tempest-VolumesActionsTest-1580478361 None] Attaching volume d8ced2ca-43e6-4167-883b-5b00ef666e8d to instance 30c6be09-fa75-4069-949f-69399d5c24e6 at mountpoint /dev/vdb on host None.
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fbe8674f-1882-491c-87a9-00c6f4b7b25d tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-795ac843-4fbd-4523-b20a-a50f9c95e307-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-0f31c611-a68d-425e-bde6-4d233457dfd2 tempest-VolumesActionsTest-1580478361 None] Attach volume completed successfully.
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0f31c611-a68d-425e-bde6-4d233457dfd2 tempest-VolumesActionsTest-1580478361 None] Lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d" released by "attach_volume" :: held 0.538s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:43 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Flow 'volume_create_manager' (b8eee2c1-d081-4b06-b5a1-75b3f02f1ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef04115-192b-496f-b492-670ad554ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef04115-192b-496f-b492-670ad554ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1756009503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10ff793-b3e9-4e78-9d3c-5a55704c9bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878d717a2ea64f208a83ff94f7dc6617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:44Z,use_quota=True,user_id='37465f7d1a534e7397e308cfb82c6a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b5faf8-9778-429a-96b6-ec8575e7ca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b5faf8-9778-429a-96b6-ec8575e7ca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417b71e3-f9d9-49ef-846d-578feb6c02ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417b71e3-f9d9-49ef-846d-578feb6c02ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd10ff793-b3e9-4e78-9d3c-5a55704c9bf6', 'volume_name': 'volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e73c86-e085-417f-8835-4298de4168fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e73c86-e085-417f-8835-4298de4168fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57537193-4042-4fb2-b422-86f76316bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:44 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Volume d10ff793-b3e9-4e78-9d3c-5a55704c9bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6', 'volume_size': 1}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1756009503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10ff793-b3e9-4e78-9d3c-5a55704c9bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878d717a2ea64f208a83ff94f7dc6617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:44Z,use_quota=True,user_id='37465f7d1a534e7397e308cfb82c6a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Creating volume d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:47:44 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:44 devstack sudo[87853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 1073741824
Apr 24 14:47:44 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:44 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.905s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-eb0b4d14-f0e0-4524-89d1-bc37ef83cce5 tempest-VolumesActionsTest-1580478361 None] Acquiring lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d-detach_volume" by "detach_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-eb0b4d14-f0e0-4524-89d1-bc37ef83cce5 tempest-VolumesActionsTest-1580478361 None] Lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:44 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-eb0b4d14-f0e0-4524-89d1-bc37ef83cce5 tempest-VolumesActionsTest-1580478361 None] Detaching volume d8ced2ca-43e6-4167-883b-5b00ef666e8d from instance 30c6be09-fa75-4069-949f-69399d5c24e6.
Apr 24 14:47:44 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-eb0b4d14-f0e0-4524-89d1-bc37ef83cce5 tempest-VolumesActionsTest-1580478361 None] Detach volume completed successfully.
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-eb0b4d14-f0e0-4524-89d1-bc37ef83cce5 tempest-VolumesActionsTest-1580478361 None] Lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d-detach_volume" released by "detach_volume" :: held 0.072s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:47:44 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 1073741824" returned: 0 in 0.855s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:45 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6
Apr 24 14:47:45 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:45 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" returned: 0 in 0.622s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:47:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57537193-4042-4fb2-b422-86f76316bebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e066c70-8c7b-4580-8737-969b6fecbc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:45 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Volume volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 (d10ff793-b3e9-4e78-9d3c-5a55704c9bf6): created successfully
Apr 24 14:47:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e066c70-8c7b-4580-8737-969b6fecbc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Flow 'volume_create_manager' (b8eee2c1-d081-4b06-b5a1-75b3f02f1ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:45 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-780a23cf-f77a-4407-aa68-d97b7a3ae675 tempest-VolumesSnapshotTestJSON-553295167 None] Created volume successfully.
Apr 24 14:47:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] Creating offline snapshot 7d21ef29-11f8-4721-bd8a-ce4b212890c4 of volume d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:47:46 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fe8957-9a2a-4d16-a653-da6af637b741]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:46 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6
Apr 24 14:47:46 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:47 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" returned: 0 in 0.775s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:47 devstack sudo[87913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4 1G
Apr 24 14:47:47 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:47 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4 1G" returned: 0 in 0.607s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:47 devstack sudo[87923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4
Apr 24 14:47:47 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:48 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4" returned: 0 in 0.552s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:48 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4 is being set with open permissions: ugo+rw
Apr 24 14:47:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:48 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4
Apr 24 14:47:48 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:48 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4" returned: 0 in 0.450s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:48 devstack sudo[87941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.info
Apr 24 14:47:48 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:49 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.info" returned: 0 in 0.601s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:49 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.info is being set with open permissions: ugo+rw
Apr 24 14:47:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:49 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.info
Apr 24 14:47:49 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:49 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.info" returned: 0 in 0.604s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.750s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:50 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-44c2dbfc-6e75-4164-8c66-5410c2a54416 tempest-VolumesSnapshotTestJSON-553295167 None] Create snapshot completed successfully
Apr 24 14:47:50 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Flow 'volume_create_manager' (1578a76f-207c-4c0b-8532-a203a86843b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5149246e-1417-48bb-9ac2-f93bc4ed0190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5149246e-1417-48bb-9ac2-f93bc4ed0190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-901078382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62362ff9-07d4-4018-9eb8-1247a6ab87ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878d717a2ea64f208a83ff94f7dc6617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7d21ef29-11f8-4721-bd8a-ce4b212890c4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:51Z,use_quota=True,user_id='37465f7d1a534e7397e308cfb82c6a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd90c59-475a-4dbb-8b2c-6d2884a5f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd90c59-475a-4dbb-8b2c-6d2884a5f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84aea369-510b-43b9-b085-795bb06a757a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84aea369-510b-43b9-b085-795bb06a757a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62362ff9-07d4-4018-9eb8-1247a6ab87ec', 'volume_name': 'volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec', 'volume_size': 1, 'snapshot_id': '7d21ef29-11f8-4721-bd8a-ce4b212890c4'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3541e1c2-1c6c-484d-a593-122cc5c19d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3541e1c2-1c6c-484d-a593-122cc5c19d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f056ef-4d62-4cd1-995f-ad9ca24dcca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:51 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Volume 62362ff9-07d4-4018-9eb8-1247a6ab87ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec', 'volume_size': 1, 'snapshot_id': '7d21ef29-11f8-4721-bd8a-ce4b212890c4'}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-7d21ef29-11f8-4721-bd8a-ce4b212890c4-62362ff9-07d4-4018-9eb8-1247a6ab87ec" by "_create_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-7d21ef29-11f8-4721-bd8a-ce4b212890c4-62362ff9-07d4-4018-9eb8-1247a6ab87ec" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Creating volume 62362ff9-07d4-4018-9eb8-1247a6ab87ec from snapshot 7d21ef29-11f8-4721-bd8a-ce4b212890c4 {{(pid=81510) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-62362ff9-07d4-4018-9eb8-1247a6ab87ec" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-62362ff9-07d4-4018-9eb8-1247a6ab87ec" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] snapshot: 7d21ef29-11f8-4721-bd8a-ce4b212890c4, volume: 62362ff9-07d4-4018-9eb8-1247a6ab87ec,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fbf07d-c3b7-4899-92c2-b313849fb158]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:51 devstack sudo[87983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4
Apr 24 14:47:51 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:51 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4" returned: 0 in 0.647s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d860dc14-73e8-44f8-b392-23ef9c01fc90]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:51 devstack sudo[87994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6
Apr 24 14:47:51 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:52 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" returned: 0 in 0.542s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:52 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:47:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:52 devstack sudo[88000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec
Apr 24 14:47:52 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:53 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:47:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (f9faf0ef-c2fa-4d1b-b70c-a163cacc26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:47:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5330ec84-4b65-4f01-a50e-4c1bae8b1550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5330ec84-4b65-4f01-a50e-4c1bae8b1550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1308163615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8750aaba-9603-4971-8ef9-31ad6d251f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:54Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efc12a0-aa47-4ddd-b508-2e2b06b77c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efc12a0-aa47-4ddd-b508-2e2b06b77c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e6ef08-170f-48a7-b5c6-2dbd93ba1927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e6ef08-170f-48a7-b5c6-2dbd93ba1927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8750aaba-9603-4971-8ef9-31ad6d251f52', 'volume_name': 'volume-8750aaba-9603-4971-8ef9-31ad6d251f52', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e442af09-21e7-45d6-b3df-fc0412dc6e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e442af09-21e7-45d6-b3df-fc0412dc6e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:47:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a74e029-f81b-48d2-989c-2997db3cc046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:47:54 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Volume 8750aaba-9603-4971-8ef9-31ad6d251f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8750aaba-9603-4971-8ef9-31ad6d251f52', 'volume_size': 1}
Apr 24 14:47:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:47:59 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec" returned: 0 in 6.820s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:59 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b57207-730c-4cd1-b7ce-cc737ac81ded]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:47:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:59 devstack sudo[88018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6
Apr 24 14:47:59 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:47:59 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root
Apr 24 14:47:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" returned: 0 in 0.705s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:47:59 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:47:59 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Converted 1024.00 MB image at 150.12 MB/s
Apr 24 14:47:59 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec is being set with open permissions: ugo+rw
Apr 24 14:47:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:47:59 devstack sudo[88023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec
Apr 24 14:47:59 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:00 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec" returned: 0 in 0.640s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-62362ff9-07d4-4018-9eb8-1247a6ab87ec" released by "_copy_volume_from_snapshot" :: held 9.464s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-7d21ef29-11f8-4721-bd8a-ce4b212890c4-62362ff9-07d4-4018-9eb8-1247a6ab87ec" released by "_create_volume_from_snapshot" :: held 9.504s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.520s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.376s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1308163615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8750aaba-9603-4971-8ef9-31ad6d251f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:47:54Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Creating volume 8750aaba-9603-4971-8ef9-31ad6d251f52 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:48:00 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:00 devstack sudo[88026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52 1073741824
Apr 24 14:48:00 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f056ef-4d62-4cd1-995f-ad9ca24dcca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec', 'volume_size': 1, 'snapshot_id': '7d21ef29-11f8-4721-bd8a-ce4b212890c4'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468bbe10-ddb0-4461-8297-8206e0974905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Volume volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec (62362ff9-07d4-4018-9eb8-1247a6ab87ec): created successfully
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468bbe10-ddb0-4461-8297-8206e0974905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Flow 'volume_create_manager' (1578a76f-207c-4c0b-8532-a203a86843b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:00 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-bd213577-c101-4664-a6a5-962f4425f3bf tempest-VolumesSnapshotTestJSON-553295167 None] Created volume successfully.
Apr 24 14:48:01 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52 1073741824" returned: 0 in 0.881s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:01 devstack sudo[88032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52
Apr 24 14:48:01 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-62362ff9-07d4-4018-9eb8-1247a6ab87ec-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-62362ff9-07d4-4018-9eb8-1247a6ab87ec-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-62362ff9-07d4-4018-9eb8-1247a6ab87ec" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-62362ff9-07d4-4018-9eb8-1247a6ab87ec" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:01 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f70506-82bc-4346-9b75-f4a161cbbb50]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:01 devstack sudo[88038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec
Apr 24 14:48:01 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:02 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52" returned: 0 in 0.754s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a74e029-f81b-48d2-989c-2997db3cc046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8750aaba-9603-4971-8ef9-31ad6d251f52', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01b0253-e2f4-47c5-bb6f-293b5cf5af45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:02 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Volume volume-8750aaba-9603-4971-8ef9-31ad6d251f52 (8750aaba-9603-4971-8ef9-31ad6d251f52): created successfully
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01b0253-e2f4-47c5-bb6f-293b5cf5af45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (f9faf0ef-c2fa-4d1b-b70c-a163cacc26d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:02 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b268e4a2-b305-4200-b341-b87beea8608b tempest-VolumesActionsTest-708199095 None] Created volume successfully.
Apr 24 14:48:02 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec" returned: 0 in 0.786s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:02 devstack sudo[88056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec
Apr 24 14:48:02 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fa0d60d6-c319-4a6d-873d-18aee8e3356b tempest-VolumesActionsTest-708199095 None] Acquiring lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52" by "attach_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fa0d60d6-c319-4a6d-873d-18aee8e3356b tempest-VolumesActionsTest-708199095 None] Lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52" acquired by "attach_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:02 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-fa0d60d6-c319-4a6d-873d-18aee8e3356b tempest-VolumesActionsTest-708199095 None] Attaching volume 8750aaba-9603-4971-8ef9-31ad6d251f52 to instance 6eed8273-26fe-4863-bb4c-868de0f51ce3 at mountpoint /dev/vdb on host None.
Apr 24 14:48:02 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-fa0d60d6-c319-4a6d-873d-18aee8e3356b tempest-VolumesActionsTest-708199095 None] Attach volume completed successfully.
Apr 24 14:48:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fa0d60d6-c319-4a6d-873d-18aee8e3356b tempest-VolumesActionsTest-708199095 None] Lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52" released by "attach_volume" :: held 0.125s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:03 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62362ff9-07d4-4018-9eb8-1247a6ab87ec" returned: 0 in 0.546s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-62362ff9-07d4-4018-9eb8-1247a6ab87ec" released by "delete_volume" :: held 1.385s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Created reservations ['44d2eabf-49cb-42af-a0fe-5bdc9923027c', '0c102625-21f7-4169-871d-d601e367cff0', 'ca8be07a-f61a-434e-8e85-7d6718688651', '47e6b3c5-9aba-419f-a015-010f1d669c00'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:03 devstack sudo[88090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:03 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:03 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a5c47982-9347-43cd-a167-34bc2c984b0d tempest-VolumesActionsTest-1613822756 None] Terminate volume connection completed successfully.
Apr 24 14:48:03 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.494s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:03 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Deleted volume successfully.
Apr 24 14:48:03 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f51d3086-a580-4ab2-bc58-a9f443cebe25 tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-62362ff9-07d4-4018-9eb8-1247a6ab87ec-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-7d21ef29-11f8-4721-bd8a-ce4b212890c4-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-7d21ef29-11f8-4721-bd8a-ce4b212890c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-7d21ef29-11f8-4721-bd8a-ce4b212890c4" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-7d21ef29-11f8-4721-bd8a-ce4b212890c4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Deleting offline snapshot 7d21ef29-11f8-4721-bd8a-ce4b212890c4 of volume d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] snapshot_file for this snap is: volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff635f6d-881d-43a2-8f00-ce2e83d5a3ac]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:04 devstack sudo[88093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4
Apr 24 14:48:04 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a5c47982-9347-43cd-a167-34bc2c984b0d tempest-VolumesActionsTest-1613822756 None] Acquiring lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52-detach_volume" by "detach_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a5c47982-9347-43cd-a167-34bc2c984b0d tempest-VolumesActionsTest-1613822756 None] Lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:04 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a5c47982-9347-43cd-a167-34bc2c984b0d tempest-VolumesActionsTest-1613822756 None] Detaching volume 8750aaba-9603-4971-8ef9-31ad6d251f52 from instance 6eed8273-26fe-4863-bb4c-868de0f51ce3.
Apr 24 14:48:04 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a5c47982-9347-43cd-a167-34bc2c984b0d tempest-VolumesActionsTest-1613822756 None] Detach volume completed successfully.
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a5c47982-9347-43cd-a167-34bc2c984b0d tempest-VolumesActionsTest-1613822756 None] Lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:04 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4" returned: 0 in 0.557s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[7017c6f9-2789-4045-ad51-505e2a4e68a3]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:04 devstack sudo[88098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6
Apr 24 14:48:04 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a24de81b-74fc-43c6-b19f-a4478950cd61 tempest-VolumesActionsTest-708199095 None] Acquiring lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52-detach_volume" by "detach_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a24de81b-74fc-43c6-b19f-a4478950cd61 tempest-VolumesActionsTest-708199095 None] Lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:04 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a24de81b-74fc-43c6-b19f-a4478950cd61 tempest-VolumesActionsTest-708199095 None] Volume detach called, but volume not attached.
Apr 24 14:48:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a24de81b-74fc-43c6-b19f-a4478950cd61 tempest-VolumesActionsTest-708199095 None] Lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:05 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" returned: 0 in 0.555s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:05 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4
Apr 24 14:48:05 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Acquiring lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Acquiring lock "cinder-quobyte-8750aaba-9603-4971-8ef9-31ad6d251f52" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Lock "cinder-quobyte-8750aaba-9603-4971-8ef9-31ad6d251f52" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:05 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b784692-8c3a-4afb-99ec-cc0b3d5e6c8d]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:05 devstack sudo[88112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52
Apr 24 14:48:05 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:05 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4" returned: 0 in 0.578s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:05 devstack sudo[88114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4
Apr 24 14:48:05 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:06 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52" returned: 0 in 0.552s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:06 devstack sudo[88120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52
Apr 24 14:48:06 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:06 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6.7d21ef29-11f8-4721-bd8a-ce4b212890c4" returned: 0 in 0.476s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-7d21ef29-11f8-4721-bd8a-ce4b212890c4" released by "_delete_snapshot" :: held 2.263s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" released by "delete_snapshot" :: held 2.283s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Created reservations ['d5fa9b01-b434-4833-b98e-a25180cd7c15', '5f8f6178-1a68-4bcd-aa36-e0dbc3b11af2', '3a08f682-1c01-442a-adc2-2b14c5ebbb11', 'cdfa43d4-d8d4-471c-bc5b-4dd418bb69fe'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:06 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Delete snapshot completed successfully.
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d91d128f-410d-4cbf-b03e-6632c22d67be tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-7d21ef29-11f8-4721-bd8a-ce4b212890c4-delete_snapshot" released by "delete_snapshot" :: held 2.396s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:06 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8750aaba-9603-4971-8ef9-31ad6d251f52" returned: 0 in 0.483s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Lock "cinder-quobyte-8750aaba-9603-4971-8ef9-31ad6d251f52" released by "delete_volume" :: held 1.075s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Created reservations ['70ddfea0-5b66-4ce4-b191-74bcf06bc5cc', 'c3febaa5-57ad-44da-85e9-750e35b3540f', '0868ffb5-616f-4ec2-af42-9c9f5b0ac6f0', '53833b64-93ca-48b0-b804-ca62914df1fe'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:06 devstack sudo[88126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:06 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:07 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b790d595-21e9-4aec-93ac-266cb46a0593]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:07 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.540s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:07 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:07 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Deleted volume successfully.
Apr 24 14:48:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f178815e-59e8-4d6e-999e-aead3a7e5c36 tempest-VolumesActionsTest-708199095 None] Lock "cinder-8750aaba-9603-4971-8ef9-31ad6d251f52-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:07 devstack sudo[88136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6
Apr 24 14:48:07 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:08 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" returned: 0 in 0.781s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:08 devstack sudo[88166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6
Apr 24 14:48:08 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:08 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" returned: 0 in 0.739s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6" released by "delete_volume" :: held 1.588s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:09 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Created reservations ['8b3d939c-9a2d-4594-8d40-9beb2a0a12ec', '5ed2acae-d3b8-4fb2-a191-8136b207bfc9', '74e3b988-076a-41c1-9669-91a3fc7f864e', '04e5246e-f3e9-4c11-8167-8a9c2c82e6c5'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:09 devstack sudo[88185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:09 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-b958973c-9167-4929-adfe-76f17c6199aa-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-b958973c-9167-4929-adfe-76f17c6199aa-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "cinder-quobyte-b958973c-9167-4929-adfe-76f17c6199aa" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-b958973c-9167-4929-adfe-76f17c6199aa" acquired by "delete_volume" :: waited 0.055s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:10 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d7f9fe-5656-4618-9913-f2c63cbb5035]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:10 devstack sudo[88206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa
Apr 24 14:48:10 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:10 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.177s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:10 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:10 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Deleted volume successfully.
Apr 24 14:48:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-11e1d907-3a30-4f54-8957-5a8bcfed2bfd tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-d10ff793-b3e9-4e78-9d3c-5a55704c9bf6-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:10 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa" returned: 0 in 0.743s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:10 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa
Apr 24 14:48:10 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:11 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b958973c-9167-4929-adfe-76f17c6199aa" returned: 0 in 0.594s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-quobyte-b958973c-9167-4929-adfe-76f17c6199aa" released by "delete_volume" :: held 1.445s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Created reservations ['906af4ee-f00f-44ed-bb2f-6b5fee23bba2', 'fd188258-d930-4fff-bdc3-16a6af5d1301', '7316c0da-1b97-4657-a0c1-6b11fc9ed138', '69f0fbd6-1a6a-4303-ad8b-e7a6d37cd818'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1bb4c1df-4885-4276-ba21-f04ef659ff19 tempest-VolumesActionsTest-1580478361 None] Acquiring lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d" by "attach_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:11 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:11 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1bb4c1df-4885-4276-ba21-f04ef659ff19 tempest-VolumesActionsTest-1580478361 None] Lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d" acquired by "attach_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1bb4c1df-4885-4276-ba21-f04ef659ff19 tempest-VolumesActionsTest-1580478361 None] Attaching volume d8ced2ca-43e6-4167-883b-5b00ef666e8d to instance 2434fd07-4dd8-4e04-9816-bd050cfa0960 at mountpoint /dev/vdb on host None.
Apr 24 14:48:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1bb4c1df-4885-4276-ba21-f04ef659ff19 tempest-VolumesActionsTest-1580478361 None] Attach volume completed successfully.
Apr 24 14:48:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1bb4c1df-4885-4276-ba21-f04ef659ff19 tempest-VolumesActionsTest-1580478361 None] Lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d" released by "attach_volume" :: held 0.085s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:12 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.498s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:12 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:12 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Deleted volume successfully.
Apr 24 14:48:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2e1dcee6-7977-42fa-82e0-6e7e7f53fada tempest-VolumesSnapshotTestJSON-553295167 None] Lock "cinder-b958973c-9167-4929-adfe-76f17c6199aa-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-042f0fb7-4c75-458a-b0cb-3b9c27dfc88f tempest-VolumesActionsTest-1580478361 None] Acquiring lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d-detach_volume" by "detach_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-042f0fb7-4c75-458a-b0cb-3b9c27dfc88f tempest-VolumesActionsTest-1580478361 None] Lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:12 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-042f0fb7-4c75-458a-b0cb-3b9c27dfc88f tempest-VolumesActionsTest-1580478361 None] Detaching volume d8ced2ca-43e6-4167-883b-5b00ef666e8d from instance 2434fd07-4dd8-4e04-9816-bd050cfa0960.
Apr 24 14:48:12 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-042f0fb7-4c75-458a-b0cb-3b9c27dfc88f tempest-VolumesActionsTest-1580478361 None] Detach volume completed successfully.
Apr 24 14:48:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-042f0fb7-4c75-458a-b0cb-3b9c27dfc88f tempest-VolumesActionsTest-1580478361 None] Lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (0c0f3fae-a318-4d89-81f9-2c8b548da030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c263a6aa-c173-4c9a-ae97-f8202efc9ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c263a6aa-c173-4c9a-ae97-f8202efc9ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1827065471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f055e887-d4c4-4122-b5e7-41136f4fb53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:16Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3a0d66-e5c6-4ddb-996b-2ec0f5f31b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3a0d66-e5c6-4ddb-996b-2ec0f5f31b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6506da-324c-407f-90e2-79f1d6f02727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6506da-324c-407f-90e2-79f1d6f02727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f055e887-d4c4-4122-b5e7-41136f4fb53d', 'volume_name': 'volume-f055e887-d4c4-4122-b5e7-41136f4fb53d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f2722b-b421-4a57-a204-2be3a7cb7674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f2722b-b421-4a57-a204-2be3a7cb7674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d6e65a-595e-4136-a08b-0d543b67a65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:16 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Volume f055e887-d4c4-4122-b5e7-41136f4fb53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f055e887-d4c4-4122-b5e7-41136f4fb53d', 'volume_size': 1}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1827065471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f055e887-d4c4-4122-b5e7-41136f4fb53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:16Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Creating volume f055e887-d4c4-4122-b5e7-41136f4fb53d {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:48:16 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:48:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:16 devstack sudo[88251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d 1073741824
Apr 24 14:48:16 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:17 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d 1073741824" returned: 0 in 0.729s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:17 devstack sudo[88256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d
Apr 24 14:48:17 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:17 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d" returned: 0 in 0.490s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:48:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d6e65a-595e-4136-a08b-0d543b67a65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f055e887-d4c4-4122-b5e7-41136f4fb53d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad0a025-eb76-4336-87a1-040262ee4b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:17 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Volume volume-f055e887-d4c4-4122-b5e7-41136f4fb53d (f055e887-d4c4-4122-b5e7-41136f4fb53d): created successfully
Apr 24 14:48:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad0a025-eb76-4336-87a1-040262ee4b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (0c0f3fae-a318-4d89-81f9-2c8b548da030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:17 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-0196e986-784a-4927-8c23-fdf13a32f762 tempest-VolumesActionsTest-708199095 None] Created volume successfully.
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Flow 'volume_create_manager' (22caa89e-22af-4e3e-ad9c-6fb75e2314b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21fecb08-16e9-4e50-93d2-5502b3243520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21fecb08-16e9-4e50-93d2-5502b3243520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1907705884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60fde92-4902-4a72-add4-e9442fdd078d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3935d167973b46c6a29668ab4e8f5207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:18Z,use_quota=True,user_id='1e2d02c4a2974b98a68dd58d4dac1caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632fdf44-7b73-41be-82ec-45c2d8a2d26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632fdf44-7b73-41be-82ec-45c2d8a2d26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5e99c3-d9a2-4985-bde9-a9976e244bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5e99c3-d9a2-4985-bde9-a9976e244bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60fde92-4902-4a72-add4-e9442fdd078d', 'volume_name': 'volume-f60fde92-4902-4a72-add4-e9442fdd078d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c73beab-f96f-4813-a645-dd8c7c0a73f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c73beab-f96f-4813-a645-dd8c7c0a73f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccad461e-1c70-4048-a756-ca6d9dfb4ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Volume f60fde92-4902-4a72-add4-e9442fdd078d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60fde92-4902-4a72-add4-e9442fdd078d', 'volume_size': 1}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1907705884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60fde92-4902-4a72-add4-e9442fdd078d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3935d167973b46c6a29668ab4e8f5207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:18Z,use_quota=True,user_id='1e2d02c4a2974b98a68dd58d4dac1caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Creating volume f60fde92-4902-4a72-add4-e9442fdd078d {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:48:18 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:18 devstack sudo[88259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d 1073741824
Apr 24 14:48:18 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Flow 'volume_create_manager' (c8b80a1b-d918-4b7c-bc97-30ebb80e0ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c5b15a-3b2a-42e2-a706-e7dba2b182bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c5b15a-3b2a-42e2-a706-e7dba2b182bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-618413384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a56187-e639-45e1-b2f4-45ee0aa7b71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3935d167973b46c6a29668ab4e8f5207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:18Z,use_quota=True,user_id='1e2d02c4a2974b98a68dd58d4dac1caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c22c7c0-5240-4043-b8c1-828de14ce2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c22c7c0-5240-4043-b8c1-828de14ce2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bd84b6-3d62-475f-87f6-cae5ef65b816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bd84b6-3d62-475f-87f6-cae5ef65b816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a56187-e639-45e1-b2f4-45ee0aa7b71e', 'volume_name': 'volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db033753-e281-4751-9bf8-d29e43581b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db033753-e281-4751-9bf8-d29e43581b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8024021-0496-47dc-91ed-d8923962cd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Volume 95a56187-e639-45e1-b2f4-45ee0aa7b71e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e', 'volume_size': 1}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Flow 'volume_create_manager' (06f16765-1d69-44c8-a182-ec7c2595b587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203661ef-73ce-4e48-afa9-dc9da76f1dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Acquiring lock "cinder-f055e887-d4c4-4122-b5e7-41136f4fb53d-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203661ef-73ce-4e48-afa9-dc9da76f1dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438227658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7968157b-ffa4-4e28-9587-2e8530611555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3935d167973b46c6a29668ab4e8f5207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:19Z,use_quota=True,user_id='1e2d02c4a2974b98a68dd58d4dac1caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85429116-aae4-4f60-b062-e3cf1a652c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85429116-aae4-4f60-b062-e3cf1a652c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e4c06f-322c-40b5-80b0-18fb87030972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e4c06f-322c-40b5-80b0-18fb87030972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7968157b-ffa4-4e28-9587-2e8530611555', 'volume_name': 'volume-7968157b-ffa4-4e28-9587-2e8530611555', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1cead3-79f7-4a38-ae46-136d14789093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1cead3-79f7-4a38-ae46-136d14789093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc34e87-908e-484f-b0e7-c95acd96240b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:18 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Volume 7968157b-ffa4-4e28-9587-2e8530611555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7968157b-ffa4-4e28-9587-2e8530611555', 'volume_size': 1}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Lock "cinder-f055e887-d4c4-4122-b5e7-41136f4fb53d-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Acquiring lock "cinder-quobyte-f055e887-d4c4-4122-b5e7-41136f4fb53d" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Lock "cinder-quobyte-f055e887-d4c4-4122-b5e7-41136f4fb53d" acquired by "delete_volume" :: waited 0.040s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[995a3069-5723-4b44-a3cc-ee382895f97e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:19 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d 1073741824" returned: 0 in 0.826s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:19 devstack sudo[88264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d
Apr 24 14:48:19 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:19 devstack sudo[88265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d
Apr 24 14:48:19 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Flow 'volume_create_manager' (1e88c8aa-3421-41d7-82bd-b4c8de958f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64c3320-38d0-4f49-861d-c05c98597a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64c3320-38d0-4f49-861d-c05c98597a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1870660338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c375426-90f4-4518-9327-f1c75339ca62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3935d167973b46c6a29668ab4e8f5207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:19Z,use_quota=True,user_id='1e2d02c4a2974b98a68dd58d4dac1caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c069db70-a2f6-49f4-a21e-518d1763e356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c069db70-a2f6-49f4-a21e-518d1763e356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5965fc-9887-495f-bbf9-a35e0f71d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5965fc-9887-495f-bbf9-a35e0f71d29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c375426-90f4-4518-9327-f1c75339ca62', 'volume_name': 'volume-6c375426-90f4-4518-9327-f1c75339ca62', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3c0a11-72dd-4879-8101-7fca16c93630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3c0a11-72dd-4879-8101-7fca16c93630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75243b4-dcca-4b7e-92c9-3b1ad83d955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:19 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Volume 6c375426-90f4-4518-9327-f1c75339ca62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c375426-90f4-4518-9327-f1c75339ca62', 'volume_size': 1}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Flow 'volume_create_manager' (4aa4f1e9-4b94-492a-9315-898f967769e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3594937d-9fd9-4044-8cea-72c30c1dfd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3594937d-9fd9-4044-8cea-72c30c1dfd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-226351917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084de492-285f-47ad-8786-49ac71331b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3935d167973b46c6a29668ab4e8f5207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:19Z,use_quota=True,user_id='1e2d02c4a2974b98a68dd58d4dac1caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b72d52a-d4bc-4b2f-b647-fd8a23ed5226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b72d52a-d4bc-4b2f-b647-fd8a23ed5226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c7dd4a-c384-44d3-9d68-b7cb4c9c5ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c7dd4a-c384-44d3-9d68-b7cb4c9c5ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084de492-285f-47ad-8786-49ac71331b61', 'volume_name': 'volume-084de492-285f-47ad-8786-49ac71331b61', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd50831d-8d50-4f5f-ab12-945da23d7278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd50831d-8d50-4f5f-ab12-945da23d7278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b0e3e9-65aa-43a1-a7aa-d6352fc236e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:19 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Volume 084de492-285f-47ad-8786-49ac71331b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084de492-285f-47ad-8786-49ac71331b61', 'volume_size': 1}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:19 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d" returned: 0 in 0.529s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.073s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-618413384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a56187-e639-45e1-b2f4-45ee0aa7b71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3935d167973b46c6a29668ab4e8f5207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:18Z,use_quota=True,user_id='1e2d02c4a2974b98a68dd58d4dac1caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Creating volume 95a56187-e639-45e1-b2f4-45ee0aa7b71e {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:48:19 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:19 devstack sudo[88272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e 1073741824
Apr 24 14:48:19 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccad461e-1c70-4048-a756-ca6d9dfb4ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60fde92-4902-4a72-add4-e9442fdd078d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1006259a-c553-4223-b138-8ff32fd510b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:19 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Volume volume-f60fde92-4902-4a72-add4-e9442fdd078d (f60fde92-4902-4a72-add4-e9442fdd078d): created successfully
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1006259a-c553-4223-b138-8ff32fd510b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Flow 'volume_create_manager' (22caa89e-22af-4e3e-ad9c-6fb75e2314b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b3ef5096-bf5e-4942-ad58-f5540de9a8cf tempest-CreateVolumesFromImageTest-858769793 None] Created volume successfully.
Apr 24 14:48:19 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d" returned: 0 in 0.670s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:19 devstack sudo[88274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d
Apr 24 14:48:19 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:20 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f055e887-d4c4-4122-b5e7-41136f4fb53d" returned: 0 in 0.502s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Lock "cinder-quobyte-f055e887-d4c4-4122-b5e7-41136f4fb53d" released by "delete_volume" :: held 1.221s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:20 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Created reservations ['8cffba5c-954b-43d6-8c0b-69edc251931a', '074682b5-9852-4c80-bd93-50d7bf26cfc6', '16d804e5-671a-49d4-9f99-29e44915d86a', '8bf7ca9a-c0d9-4115-a822-68bba9a84091'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e 1073741824" returned: 0 in 0.649s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:20 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:20 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:20 devstack sudo[88282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:20 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:20 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:20 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.499s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e" returned: 0 in 0.542s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:20 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Deleted volume successfully.
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.978s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438227658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7968157b-ffa4-4e28-9587-2e8530611555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3935d167973b46c6a29668ab4e8f5207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:19Z,use_quota=True,user_id='1e2d02c4a2974b98a68dd58d4dac1caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Creating volume 7968157b-ffa4-4e28-9587-2e8530611555 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:48:20 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8024021-0496-47dc-91ed-d8923962cd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:20 devstack sudo[88286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555 1073741824
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae270e3-ad9f-414d-9862-7a8db7027d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:20 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:20 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Volume volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e (95a56187-e639-45e1-b2f4-45ee0aa7b71e): created successfully
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae270e3-ad9f-414d-9862-7a8db7027d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Flow 'volume_create_manager' (c8b80a1b-d918-4b7c-bc97-30ebb80e0ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-957b96c2-46eb-4711-82dd-5f0b3204d5df tempest-VolumesActionsTest-1613822756 None] Lock "cinder-f055e887-d4c4-4122-b5e7-41136f4fb53d-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:20 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d82dbf14-0ab3-4896-8baa-59baf48ad19d tempest-CreateVolumesFromImageTest-858769793 None] Created volume successfully.
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (250f404e-f1ae-427f-a0c8-ddd2dc015ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d933dce4-bc40-4157-88f5-83d200014fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d933dce4-bc40-4157-88f5-83d200014fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-96826505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f006306a-3881-487c-959c-c91a2f28b47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:21Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b8f95c-104c-4a8b-b58d-99181f7a6030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b8f95c-104c-4a8b-b58d-99181f7a6030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbb9e03-967f-47e8-9eaa-5577081594f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbb9e03-967f-47e8-9eaa-5577081594f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f006306a-3881-487c-959c-c91a2f28b47e', 'volume_name': 'volume-f006306a-3881-487c-959c-c91a2f28b47e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9432b01-70db-4e30-9f7c-2d68e496667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9432b01-70db-4e30-9f7c-2d68e496667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035cfb8c-3772-4e39-a55b-8d61ccc88892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:21 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Volume f006306a-3881-487c-959c-c91a2f28b47e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f006306a-3881-487c-959c-c91a2f28b47e', 'volume_size': 1}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:21 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555 1073741824" returned: 0 in 0.795s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:21 devstack sudo[88291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555
Apr 24 14:48:21 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:22 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555" returned: 0 in 0.469s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.991s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1870660338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c375426-90f4-4518-9327-f1c75339ca62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3935d167973b46c6a29668ab4e8f5207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:19Z,use_quota=True,user_id='1e2d02c4a2974b98a68dd58d4dac1caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Creating volume 6c375426-90f4-4518-9327-f1c75339ca62 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:48:22 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc34e87-908e-484f-b0e7-c95acd96240b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7968157b-ffa4-4e28-9587-2e8530611555', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:22 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62 1073741824
Apr 24 14:48:22 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6960ba38-d10b-4ae1-9ea8-baf5e685ffdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:22 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Volume volume-7968157b-ffa4-4e28-9587-2e8530611555 (7968157b-ffa4-4e28-9587-2e8530611555): created successfully
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6960ba38-d10b-4ae1-9ea8-baf5e685ffdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Flow 'volume_create_manager' (06f16765-1d69-44c8-a182-ec7c2595b587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:22 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-802a9809-5f10-47a5-9d3f-f60090e0fdfd tempest-CreateVolumesFromImageTest-858769793 None] Created volume successfully.
Apr 24 14:48:22 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62 1073741824" returned: 0 in 0.605s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:22 devstack sudo[88300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62
Apr 24 14:48:22 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:23 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62" returned: 0 in 0.468s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.790s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-226351917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084de492-285f-47ad-8786-49ac71331b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3935d167973b46c6a29668ab4e8f5207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:19Z,use_quota=True,user_id='1e2d02c4a2974b98a68dd58d4dac1caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Creating volume 084de492-285f-47ad-8786-49ac71331b61 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:48:23 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75243b4-dcca-4b7e-92c9-3b1ad83d955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c375426-90f4-4518-9327-f1c75339ca62', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:23 devstack sudo[88303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61 1073741824
Apr 24 14:48:23 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5943ca23-eaba-44ac-abcb-436156120774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:23 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Volume volume-6c375426-90f4-4518-9327-f1c75339ca62 (6c375426-90f4-4518-9327-f1c75339ca62): created successfully
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5943ca23-eaba-44ac-abcb-436156120774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Flow 'volume_create_manager' (1e88c8aa-3421-41d7-82bd-b4c8de958f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:23 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c9a311a7-c255-4ab3-8d65-85fb02c3dff7 tempest-CreateVolumesFromImageTest-858769793 None] Created volume successfully.
Apr 24 14:48:23 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61 1073741824" returned: 0 in 0.642s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:23 devstack sudo[88342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61
Apr 24 14:48:24 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:24 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61" returned: 0 in 0.432s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.808s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-96826505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f006306a-3881-487c-959c-c91a2f28b47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:21Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Creating volume f006306a-3881-487c-959c-c91a2f28b47e {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:48:24 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b0e3e9-65aa-43a1-a7aa-d6352fc236e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084de492-285f-47ad-8786-49ac71331b61', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:24 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e 1073741824
Apr 24 14:48:24 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c96d96-a91c-4f01-a751-cc20cbecb872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:24 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Volume volume-084de492-285f-47ad-8786-49ac71331b61 (084de492-285f-47ad-8786-49ac71331b61): created successfully
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c96d96-a91c-4f01-a751-cc20cbecb872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Flow 'volume_create_manager' (4aa4f1e9-4b94-492a-9315-898f967769e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:24 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-df83d045-6132-4cad-99a3-568f31974fd1 tempest-CreateVolumesFromImageTest-858769793 None] Created volume successfully.
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "cinder-084de492-285f-47ad-8786-49ac71331b61-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-084de492-285f-47ad-8786-49ac71331b61-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "cinder-quobyte-084de492-285f-47ad-8786-49ac71331b61" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:25 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e 1073741824" returned: 0 in 0.632s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-quobyte-084de492-285f-47ad-8786-49ac71331b61" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[60172c3e-5064-4ea4-81ca-84b275327871]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:25 devstack sudo[88351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e
Apr 24 14:48:25 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:25 devstack sudo[88350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61
Apr 24 14:48:25 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:25 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e" returned: 0 in 0.451s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.416s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035cfb8c-3772-4e39-a55b-8d61ccc88892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f006306a-3881-487c-959c-c91a2f28b47e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0205d5f-5331-49c4-9236-b91c72f0d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:25 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb2b45f-826b-4a7c-861f-e142813103cf]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61" returned: 0 in 0.530s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:25 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Volume volume-f006306a-3881-487c-959c-c91a2f28b47e (f006306a-3881-487c-959c-c91a2f28b47e): created successfully
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0205d5f-5331-49c4-9236-b91c72f0d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (250f404e-f1ae-427f-a0c8-ddd2dc015ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:25 devstack sudo[88359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61
Apr 24 14:48:25 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:25 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-94b84433-a867-470c-a266-db23690eef57 tempest-VolumesActionsTest-708199095 None] Created volume successfully.
Apr 24 14:48:25 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d
Apr 24 14:48:25 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Acquiring lock "cinder-f006306a-3881-487c-959c-c91a2f28b47e-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Lock "cinder-f006306a-3881-487c-959c-c91a2f28b47e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Acquiring lock "cinder-quobyte-f006306a-3881-487c-959c-c91a2f28b47e" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Lock "cinder-quobyte-f006306a-3881-487c-959c-c91a2f28b47e" acquired by "delete_volume" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[9313265f-c2b5-4235-ae8b-39820cba888e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:26 devstack sudo[88362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e
Apr 24 14:48:26 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:26 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d" returned: 0 in 0.568s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ce9375-1e95-469a-999e-dd87dc0ad5df]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:26 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-084de492-285f-47ad-8786-49ac71331b61" returned: 0 in 0.592s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-quobyte-084de492-285f-47ad-8786-49ac71331b61" released by "delete_volume" :: held 1.160s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Created reservations ['614eb648-53ce-4a2f-82dd-de4872d7db7d', 'f6d7a72b-92e2-498f-a47f-4dfb2221618d', '052ec97c-c7c0-459e-b52b-2a23f56b0f4f', 'ae9cf7e8-fcea-47c7-9141-25cbf6ac971b'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:26 devstack sudo[88368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d
Apr 24 14:48:26 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:26 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:26 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:26 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e" returned: 0 in 0.559s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:26 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e
Apr 24 14:48:26 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:26 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d" returned: 0 in 0.607s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.cd3fe3bd-6e54-4647-b153-556913a94cd2r6mb_7en.img {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:26 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.cd3fe3bd-6e54-4647-b153-556913a94cd2r6mb_7en.img
Apr 24 14:48:26 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:26 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.519s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:26 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Deleted volume successfully.
Apr 24 14:48:26 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-43ccdf00-363a-4cca-b45a-53f538f78915 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-084de492-285f-47ad-8786-49ac71331b61-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:27 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f006306a-3881-487c-959c-c91a2f28b47e" returned: 0 in 0.458s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Lock "cinder-quobyte-f006306a-3881-487c-959c-c91a2f28b47e" released by "delete_volume" :: held 1.057s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Created reservations ['ada9e9cd-9420-408f-b5dd-37e8bf41c4e1', 'e253d069-ccb6-4ae2-ab79-7c2c6918e1b0', 'df503698-67c3-491e-a435-58b439d18d40', '1c5edf63-ef83-4198-8fc0-572e6b238673'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:27 devstack sudo[88384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:27 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "cinder-6c375426-90f4-4518-9327-f1c75339ca62-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-6c375426-90f4-4518-9327-f1c75339ca62-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "cinder-quobyte-6c375426-90f4-4518-9327-f1c75339ca62" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-quobyte-6c375426-90f4-4518-9327-f1c75339ca62" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba7ed84-784d-41a4-bafe-8e233816919c]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:27 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62
Apr 24 14:48:27 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:28 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.930s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:28 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:28 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Deleted volume successfully.
Apr 24 14:48:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-281a4fad-32ee-45ec-b5f3-09b1f97a0a2f tempest-VolumesActionsTest-1613822756 None] Lock "cinder-f006306a-3881-487c-959c-c91a2f28b47e-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:28 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:48:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (683ee1ba-88a3-479a-874c-31a414fc5b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b7b32c-a454-41d6-badd-b68ca9f0cb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b7b32c-a454-41d6-badd-b68ca9f0cb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-954502300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb08642-4e48-4ed3-a2f3-60bc0321667e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:29Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf415664-959e-4193-9460-46129abe7edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf415664-959e-4193-9460-46129abe7edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d13f51-15b6-40b2-b801-de2e27c0f916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d13f51-15b6-40b2-b801-de2e27c0f916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddb08642-4e48-4ed3-a2f3-60bc0321667e', 'volume_name': 'volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fe6cba-8ecb-452d-b4bd-7f0092b2409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fe6cba-8ecb-452d-b4bd-7f0092b2409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a613a7f-90cd-4263-98b7-e790d1ec08b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:29 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Volume ddb08642-4e48-4ed3-a2f3-60bc0321667e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e', 'volume_size': 1}
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:29 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62" returned: 0 in 1.846s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:29 devstack sudo[88402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62
Apr 24 14:48:29 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:30 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6c375426-90f4-4518-9327-f1c75339ca62" returned: 0 in 0.987s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-quobyte-6c375426-90f4-4518-9327-f1c75339ca62" released by "delete_volume" :: held 2.890s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Created reservations ['095e1f8b-d0fc-4590-ba2d-4b0dca2f6103', '679e64aa-1381-4dc0-b24b-036d8e69c7bb', '21ad03af-1e06-4794-bf54-dcac3b6f5717', 'fab8fba7-af2c-48fe-aac1-a524ff82d5d1'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:30 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:30 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "cinder-7968157b-ffa4-4e28-9587-2e8530611555-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-7968157b-ffa4-4e28-9587-2e8530611555-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "cinder-quobyte-7968157b-ffa4-4e28-9587-2e8530611555" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-quobyte-7968157b-ffa4-4e28-9587-2e8530611555" acquired by "delete_volume" :: waited 0.030s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:31 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a584aa24-1161-4284-9afa-60ab50499406]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:31 devstack sudo[88407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555
Apr 24 14:48:31 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:31 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.336s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:31 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:31 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Deleted volume successfully.
Apr 24 14:48:31 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ccd0cba7-43c4-43de-afac-25495d6befc3 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-6c375426-90f4-4518-9327-f1c75339ca62-delete_volume" released by "delete_volume" :: held 4.508s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:32 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555" returned: 0 in 1.116s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:32 devstack sudo[88413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555
Apr 24 14:48:32 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:32 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.cd3fe3bd-6e54-4647-b153-556913a94cd2r6mb_7en.img" returned: 0 in 5.386s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[457167c6-1e4f-4fda-a3d2-c3afeaa38c34]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:32 devstack sudo[88415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d
Apr 24 14:48:32 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:32 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-7968157b-ffa4-4e28-9587-2e8530611555" returned: 0 in 0.440s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-quobyte-7968157b-ffa4-4e28-9587-2e8530611555" released by "delete_volume" :: held 1.645s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Created reservations ['ab4fcd47-22bf-46e8-8c31-6590e5a9f6e7', 'd14e7e0b-2f0d-4a87-b606-740080a15387', '18b9f77c-225d-4bef-9586-214ba7e3c5bc', '2665aa1c-f1a4-4482-8eff-1f36d93529c6'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:32 devstack sudo[88421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:32 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:32 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d" returned: 0 in 0.674s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.cd3fe3bd-6e54-4647-b153-556913a94cd2r6mb_7en.img {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:48:32 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] Converted 1024.00 MB image at 190.05 MB/s
Apr 24 14:48:32 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] cd3fe3bd-6e54-4647-b153-556913a94cd2 was raw, no need to convert to raw {{(pid=81510) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 24 14:48:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "cinder-95a56187-e639-45e1-b2f4-45ee0aa7b71e-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-95a56187-e639-45e1-b2f4-45ee0aa7b71e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:33 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.502s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:33 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:33 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Deleted volume successfully.
Apr 24 14:48:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "cinder-quobyte-95a56187-e639-45e1-b2f4-45ee0aa7b71e" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b7becfdf-ff7e-467b-891d-8281ebf93b62 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-7968157b-ffa4-4e28-9587-2e8530611555-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-quobyte-95a56187-e639-45e1-b2f4-45ee0aa7b71e" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:33 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae8a03e-3f12-4e2e-8a4d-ec3f662f2549]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:33 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e
Apr 24 14:48:33 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:33 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e" returned: 0 in 0.528s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:33 devstack sudo[88430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e
Apr 24 14:48:33 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:34 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-95a56187-e639-45e1-b2f4-45ee0aa7b71e" returned: 0 in 0.508s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-quobyte-95a56187-e639-45e1-b2f4-45ee0aa7b71e" released by "delete_volume" :: held 1.076s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Created reservations ['57049597-0c52-40db-8dd9-3b193fe021ba', '41552de2-a22a-41aa-9e64-ff3541a2e173', '3192eb06-6672-4394-9f97-74fca2f10346', 'c8fe7c90-78f2-4424-9405-fcfe0256760d'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:34 devstack sudo[88433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:34 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:34 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.489s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:34 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Deleted volume successfully.
Apr 24 14:48:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5921e756-5425-44ea-a1dd-317ee80c141f tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-95a56187-e639-45e1-b2f4-45ee0aa7b71e-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "cinder-f60fde92-4902-4a72-add4-e9442fdd078d-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-f60fde92-4902-4a72-add4-e9442fdd078d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "cinder-quobyte-f60fde92-4902-4a72-add4-e9442fdd078d" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-quobyte-f60fde92-4902-4a72-add4-e9442fdd078d" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:35 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeacb643-3b30-4a60-8e45-a4c95ee85d42]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:35 devstack sudo[88436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d
Apr 24 14:48:35 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:36 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d" returned: 0 in 0.570s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:36 devstack sudo[88441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d
Apr 24 14:48:36 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:36 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f60fde92-4902-4a72-add4-e9442fdd078d" returned: 0 in 0.478s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-quobyte-f60fde92-4902-4a72-add4-e9442fdd078d" released by "delete_volume" :: held 1.093s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:36 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Created reservations ['ffd8a5c7-ab38-4f5c-a02b-c39e857ace4a', '5bb77436-9a8f-4222-9cd6-52326bad0ef0', '7c6b736c-e098-479c-bc1e-763f8002ce7c', '1a9d1db4-bf45-40b0-bb6b-69513e9ab1dd'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:36 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:36 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:37 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.491s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:37 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:37 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Deleted volume successfully.
Apr 24 14:48:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-81149305-6232-4c76-9580-ac112a933b97 tempest-CreateVolumesFromImageTest-858769793 None] Lock "cinder-f60fde92-4902-4a72-add4-e9442fdd078d-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:48:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:43 devstack sudo[88450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:43 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:43 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.447s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:43 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:46 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=103,cinder:INSERT=27,cinder:UPDATE=147,cinder:DELETE=14 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:48:47 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=114,cinder:UPDATE=132,cinder:INSERT=38,cinder:DELETE=9 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 22.763s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] Uploaded volume to glance image-id: cd3fe3bd-6e54-4647-b153-556913a94cd2. {{(pid=81510) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.172s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-954502300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb08642-4e48-4ed3-a2f3-60bc0321667e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:29Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Creating volume ddb08642-4e48-4ed3-a2f3-60bc0321667e {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:48:48 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:48 devstack sudo[88454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e 1073741824
Apr 24 14:48:48 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:48 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4dcef4f7-bfc0-4432-b9fc-f8b464e8252c tempest-VolumesActionsTest-1580478361 None] Copy volume to image completed successfully.
Apr 24 14:48:48 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e 1073741824" returned: 0 in 0.630s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:49 devstack sudo[88459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e
Apr 24 14:48:49 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:49 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e" returned: 0 in 0.528s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a613a7f-90cd-4263-98b7-e790d1ec08b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caccc0e0-5226-4bb6-92ea-ed9d9332e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:49 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Volume volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e (ddb08642-4e48-4ed3-a2f3-60bc0321667e): created successfully
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caccc0e0-5226-4bb6-92ea-ed9d9332e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (683ee1ba-88a3-479a-874c-31a414fc5b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:49 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f0fbd81e-d708-4cde-8f0f-e248c1010163 tempest-VolumesActionsTest-708199095 None] Created volume successfully.
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc268502-6805-4cc6-be73-621b707de2d0]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:50 devstack sudo[88462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d
Apr 24 14:48:50 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:50 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Acquiring lock "cinder-ddb08642-4e48-4ed3-a2f3-60bc0321667e-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:50 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Lock "cinder-ddb08642-4e48-4ed3-a2f3-60bc0321667e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:50 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:50 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Acquiring lock "cinder-quobyte-ddb08642-4e48-4ed3-a2f3-60bc0321667e" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:48:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d" returned: 0 in 0.586s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:50 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Lock "cinder-quobyte-ddb08642-4e48-4ed3-a2f3-60bc0321667e" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:48:50 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dbc2bc-67a3-4471-b793-aacea881e7aa]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:50 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba40edde-2014-4719-8e63-6db645630622]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:50 devstack sudo[88469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d
Apr 24 14:48:50 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:50 devstack sudo[88470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e
Apr 24 14:48:50 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:51 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e" returned: 0 in 0.521s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:51 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d" returned: 0 in 0.543s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:51 devstack sudo[88479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e
Apr 24 14:48:51 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:51 devstack sudo[88480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img
Apr 24 14:48:51 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:51 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ddb08642-4e48-4ed3-a2f3-60bc0321667e" returned: 0 in 0.457s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Lock "cinder-quobyte-ddb08642-4e48-4ed3-a2f3-60bc0321667e" released by "delete_volume" :: held 1.037s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Created reservations ['ef2db383-75ba-4c2f-bedc-bb849e0c2fe5', 'a0f43455-6ccf-4691-9a71-e1bd00464b02', '317e3b5c-0dbf-4848-972a-7786b5953ea8', 'f63735b4-0cd7-4686-89cc-88f1efebb98a'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:51 devstack sudo[88494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:48:51 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:52 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.112s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:52 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:48:52 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Deleted volume successfully.
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6efa5356-294a-4c8d-9ec1-b56369a9d0e0 tempest-VolumesActionsTest-1613822756 None] Lock "cinder-ddb08642-4e48-4ed3-a2f3-60bc0321667e-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (4d41af66-9ac2-4d64-8f82-851deacee0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8322beb1-af9f-4972-86bb-1ed26e12d088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8322beb1-af9f-4972-86bb-1ed26e12d088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1388416625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e6e479-1961-454a-8833-e7389d152933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:54Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c2655b-89aa-47b1-9045-1fa464e709bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c2655b-89aa-47b1-9045-1fa464e709bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7a52da-8a3e-468c-a96a-fa329c901a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7a52da-8a3e-468c-a96a-fa329c901a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e6e479-1961-454a-8833-e7389d152933', 'volume_name': 'volume-92e6e479-1961-454a-8833-e7389d152933', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efb6453-178b-42ca-abca-46e3f1888c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efb6453-178b-42ca-abca-46e3f1888c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6eacd4-7aba-4dae-80f8-fa17e3ef4a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:48:53 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Volume 92e6e479-1961-454a-8833-e7389d152933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e6e479-1961-454a-8833-e7389d152933', 'volume_size': 1}
Apr 24 14:48:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:55 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img" returned: 0 in 4.611s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:55 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[50744afc-e553-4a85-895b-43ef6bd1a49a]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:55 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d
Apr 24 14:48:55 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:56 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d" returned: 0 in 0.652s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:56 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:48:56 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Converted 1024.00 MB image at 222.02 MB/s
Apr 24 14:48:56 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] 512ce90d-1a59-481b-9a7e-333b8b6ab885 was raw, converting to qcow2 {{(pid=81510) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 24 14:48:56 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e8c1e9-93e6-4458-9033-1ffba59ce0d6]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:56 devstack sudo[88509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img
Apr 24 14:48:56 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:56 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img" returned: 0 in 0.501s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:57 devstack sudo[88513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img
Apr 24 14:48:57 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:57 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img" returned: 1 in 0.471s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:48:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img /opt/stack/data/cinder/conversion/vol_upload_haxrh9t2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:57 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img /opt/stack/data/cinder/conversion/vol_upload_haxrh9t2
Apr 24 14:48:57 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:57 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img /opt/stack/data/cinder/conversion/vol_upload_haxrh9t2" returned: 0 in 0.456s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:57 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Image conversion details: src /opt/stack/data/cinder/conversion/d8ced2ca-43e6-4167-883b-5b00ef666e8d.temp_image.512ce90d-1a59-481b-9a7e-333b8b6ab8854u387w76.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_haxrh9t2 {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:48:57 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 24 14:48:57 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[373ea07e-622f-4e84-9aae-fc18821e045e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:48:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_haxrh9t2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:57 devstack sudo[88523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_haxrh9t2
Apr 24 14:48:57 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:48:58 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root
Apr 24 14:48:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_haxrh9t2" returned: 0 in 0.488s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.548s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Uploaded volume to glance image-id: 512ce90d-1a59-481b-9a7e-333b8b6ab885. {{(pid=81510) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.645s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1388416625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e6e479-1961-454a-8833-e7389d152933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:48:54Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Creating volume 92e6e479-1961-454a-8833-e7389d152933 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:48:59 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:48:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:48:59 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4da3b5f5-1eec-400d-9394-c3e899301949 tempest-VolumesActionsTest-1580478361 None] Copy volume to image completed successfully.
Apr 24 14:48:59 devstack sudo[88528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933 1073741824
Apr 24 14:48:59 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:00 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933 1073741824" returned: 0 in 0.609s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:00 devstack sudo[88533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933
Apr 24 14:49:00 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:00 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933" returned: 0 in 0.466s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6eacd4-7aba-4dae-80f8-fa17e3ef4a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e6e479-1961-454a-8833-e7389d152933', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c877ed-1d92-4242-9e57-d88d094a81ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Volume volume-92e6e479-1961-454a-8833-e7389d152933 (92e6e479-1961-454a-8833-e7389d152933): created successfully
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c877ed-1d92-4242-9e57-d88d094a81ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (4d41af66-9ac2-4d64-8f82-851deacee0c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:00 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1a8fb187-9d72-4ff3-bf69-887cda1b617f tempest-VolumesActionsTest-708199095 None] Created volume successfully.
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Acquiring lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Acquiring lock "cinder-quobyte-d8ced2ca-43e6-4167-883b-5b00ef666e8d" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Lock "cinder-quobyte-d8ced2ca-43e6-4167-883b-5b00ef666e8d" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f001435-f61f-4af5-a973-a2ba44c31a25]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:01 devstack sudo[88536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d
Apr 24 14:49:01 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Acquiring lock "cinder-92e6e479-1961-454a-8833-e7389d152933-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Lock "cinder-92e6e479-1961-454a-8833-e7389d152933-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Acquiring lock "cinder-quobyte-92e6e479-1961-454a-8833-e7389d152933" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Lock "cinder-quobyte-92e6e479-1961-454a-8833-e7389d152933" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30e4e9e-1581-42ae-b49a-f6532d0d6037]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:01 devstack sudo[88541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933
Apr 24 14:49:01 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:01 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d" returned: 0 in 0.531s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:01 devstack sudo[88543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d
Apr 24 14:49:01 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:01 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933" returned: 0 in 0.516s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:01 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933
Apr 24 14:49:01 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:01 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8ced2ca-43e6-4167-883b-5b00ef666e8d" returned: 0 in 0.468s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Lock "cinder-quobyte-d8ced2ca-43e6-4167-883b-5b00ef666e8d" released by "delete_volume" :: held 1.040s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Created reservations ['d7ff3ecb-1669-41db-bc6b-25f26658a20e', '6d3bd059-7317-4359-b41e-d9b6dd7471fc', '223c71da-6c21-403b-8b08-8b7cbc86267b', '55d2a71a-4d2f-48fd-beef-7b25aa25443e'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:02 devstack sudo[88551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:02 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:02 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-92e6e479-1961-454a-8833-e7389d152933" returned: 0 in 0.459s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Lock "cinder-quobyte-92e6e479-1961-454a-8833-e7389d152933" released by "delete_volume" :: held 1.017s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Created reservations ['1005e9df-e4cb-4ce8-bb74-420face6ebda', '2bcf7170-491a-4855-b31c-c7da510bc6ba', 'e835786c-1969-43f7-a4ec-91efc2b20585', '6c7902db-3ce8-42f4-8519-6242ea013c9b'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:02 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:02 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:02 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.485s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:02 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Deleted volume successfully.
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b2f4a0b9-7454-4364-a100-8607088b928a tempest-VolumesActionsTest-1580478361 None] Lock "cinder-d8ced2ca-43e6-4167-883b-5b00ef666e8d-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:02 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.454s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:02 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:02 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Deleted volume successfully.
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a1fecd40-2eaf-4773-aa84-602ffb8edbe1 tempest-VolumesActionsTest-1613822756 None] Lock "cinder-92e6e479-1961-454a-8833-e7389d152933-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (98a47a31-5357-442a-9395-fb1943819070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de62fd8-8864-4866-a723-ad492863afc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de62fd8-8864-4866-a723-ad492863afc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1965210650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63815248-9258-411d-9653-29013d8f09dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:04Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3a01ee-bc3b-4bd8-8aa1-e626b28700a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3a01ee-bc3b-4bd8-8aa1-e626b28700a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e29522-de60-4d20-9b0d-ea068a6d19c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e29522-de60-4d20-9b0d-ea068a6d19c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63815248-9258-411d-9653-29013d8f09dc', 'volume_name': 'volume-63815248-9258-411d-9653-29013d8f09dc', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f529b6-0c2e-4909-a022-b94705cc674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f529b6-0c2e-4909-a022-b94705cc674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac28687-9e3e-4a48-975b-eb042ba3a724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:03 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Volume 63815248-9258-411d-9653-29013d8f09dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63815248-9258-411d-9653-29013d8f09dc', 'volume_size': 1}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1965210650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63815248-9258-411d-9653-29013d8f09dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7244f136c824cc5931bb49a75cbffb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:04Z,use_quota=True,user_id='d9a43615c90d4b1e84c376f032e248b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Creating volume 63815248-9258-411d-9653-29013d8f09dc {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:04 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:04 devstack sudo[88560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc 1073741824
Apr 24 14:49:04 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:04 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc 1073741824" returned: 0 in 0.657s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:04 devstack sudo[88566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc
Apr 24 14:49:04 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:05 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc" returned: 0 in 0.477s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac28687-9e3e-4a48-975b-eb042ba3a724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63815248-9258-411d-9653-29013d8f09dc', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc58b292-5939-48ba-8976-c4d39b9117e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:05 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Volume volume-63815248-9258-411d-9653-29013d8f09dc (63815248-9258-411d-9653-29013d8f09dc): created successfully
Apr 24 14:49:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc58b292-5939-48ba-8976-c4d39b9117e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Flow 'volume_create_manager' (98a47a31-5357-442a-9395-fb1943819070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:05 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6482c507-651a-4f67-857f-ffe692516326 tempest-VolumesActionsTest-708199095 None] Created volume successfully.
Apr 24 14:49:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Acquiring lock "cinder-63815248-9258-411d-9653-29013d8f09dc-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Lock "cinder-63815248-9258-411d-9653-29013d8f09dc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Acquiring lock "cinder-quobyte-63815248-9258-411d-9653-29013d8f09dc" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Lock "cinder-quobyte-63815248-9258-411d-9653-29013d8f09dc" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:06 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec70ab9f-263e-467e-8adf-800ee9f5bd9b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:06 devstack sudo[88570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc
Apr 24 14:49:06 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:07 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc" returned: 0 in 0.612s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:07 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc
Apr 24 14:49:07 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:07 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63815248-9258-411d-9653-29013d8f09dc" returned: 0 in 0.497s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Lock "cinder-quobyte-63815248-9258-411d-9653-29013d8f09dc" released by "delete_volume" :: held 1.155s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:07 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Created reservations ['914351c2-6222-4214-b0b1-78dec3ade3e1', '5d0b39f4-4411-40ec-a6e7-a40e5f568d67', 'ccd29ef1-4397-439a-8c13-fc9113d872d6', 'e06eac6d-aa98-4cdd-8954-7b55091e765e'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:08 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:08 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (5beefe0c-f299-45cb-8db3-e2c3653e0177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:08 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a5e8bb-0026-40c8-9b62-3572525ab485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.483s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:08 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Deleted volume successfully.
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a5e8bb-0026-40c8-9b62-3572525ab485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-503722252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e2c61e-2900-4d07-a317-23803e17f2d9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:08Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc191d57-015f-48b0-bfbe-9ab9cfc48f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc191d57-015f-48b0-bfbe-9ab9cfc48f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b84457d-c78a-4b00-8feb-10af2e0296d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b84457d-c78a-4b00-8feb-10af2e0296d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8e2c61e-2900-4d07-a317-23803e17f2d9', 'volume_name': 'volume-d8e2c61e-2900-4d07-a317-23803e17f2d9', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa19ee9c-ad64-4de1-8c4c-2ff97ff96371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa19ee9c-ad64-4de1-8c4c-2ff97ff96371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63126fc3-a624-4a04-a018-2239630a0fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:08 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Volume d8e2c61e-2900-4d07-a317-23803e17f2d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8e2c61e-2900-4d07-a317-23803e17f2d9', 'volume_size': 1}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-503722252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e2c61e-2900-4d07-a317-23803e17f2d9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:08Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Creating volume d8e2c61e-2900-4d07-a317-23803e17f2d9 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:08 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:08 devstack sudo[88581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9 1073741824
Apr 24 14:49:08 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a83a35c1-d3ae-49cb-ae1b-bfbcd95c7d0e tempest-VolumesActionsTest-708199095 None] Lock "cinder-63815248-9258-411d-9653-29013d8f09dc-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:09 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9 1073741824" returned: 0 in 0.642s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:09 devstack sudo[88586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9
Apr 24 14:49:09 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:09 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9" returned: 0 in 0.462s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63126fc3-a624-4a04-a018-2239630a0fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e2c61e-2900-4d07-a317-23803e17f2d9', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43730c5-0cd7-432f-b4b9-5ecc783b0845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:09 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Volume volume-d8e2c61e-2900-4d07-a317-23803e17f2d9 (d8e2c61e-2900-4d07-a317-23803e17f2d9): created successfully
Apr 24 14:49:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43730c5-0cd7-432f-b4b9-5ecc783b0845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (5beefe0c-f299-45cb-8db3-e2c3653e0177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:09 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-70bd31b3-c658-46c7-aa33-b4306cd9141c tempest-VolumesGetTest-693540363 None] Created volume successfully.
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (b3a81f5a-992a-4db4-ac44-b9496acb522b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01936d86-803f-4f8c-a819-5df30e980d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01936d86-803f-4f8c-a819-5df30e980d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1809559617',display_name='tempest-VolumesGetTest-Volume-1410871585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd85c864-f0de-47e0-bddd-30e10a8e5262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:11Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ceddea-a3d0-4c06-a6b3-26634b46dcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ceddea-a3d0-4c06-a6b3-26634b46dcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66be73e5-33d8-463e-815a-b48b9482f9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66be73e5-33d8-463e-815a-b48b9482f9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd85c864-f0de-47e0-bddd-30e10a8e5262', 'volume_name': 'volume-cd85c864-f0de-47e0-bddd-30e10a8e5262', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd4932c-0c10-4cca-9ca0-494c35750675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd4932c-0c10-4cca-9ca0-494c35750675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4771cc4-b8fc-4592-a0c9-3053a8dd381a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:11 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Volume cd85c864-f0de-47e0-bddd-30e10a8e5262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd85c864-f0de-47e0-bddd-30e10a8e5262', 'volume_size': 1}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1809559617',display_name='tempest-VolumesGetTest-Volume-1410871585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd85c864-f0de-47e0-bddd-30e10a8e5262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:11Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Creating volume cd85c864-f0de-47e0-bddd-30e10a8e5262 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:11 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:11 devstack sudo[88590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262 1073741824
Apr 24 14:49:11 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:12 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262 1073741824" returned: 0 in 0.668s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:12 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262
Apr 24 14:49:12 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:12 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262" returned: 0 in 0.514s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4771cc4-b8fc-4592-a0c9-3053a8dd381a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd85c864-f0de-47e0-bddd-30e10a8e5262', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df14d378-68e7-4041-af3e-671abc516e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:12 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Volume volume-cd85c864-f0de-47e0-bddd-30e10a8e5262 (cd85c864-f0de-47e0-bddd-30e10a8e5262): created successfully
Apr 24 14:49:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df14d378-68e7-4041-af3e-671abc516e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (b3a81f5a-992a-4db4-ac44-b9496acb522b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:12 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-8c18e8d0-16bb-4c77-ad7d-04bddf5ca7e9 tempest-VolumesGetTest-693540363 None] Created volume successfully.
Apr 24 14:49:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-cd85c864-f0de-47e0-bddd-30e10a8e5262-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Lock "cinder-cd85c864-f0de-47e0-bddd-30e10a8e5262-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-quobyte-cd85c864-f0de-47e0-bddd-30e10a8e5262" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-cd85c864-f0de-47e0-bddd-30e10a8e5262" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:13 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[4617ab6c-b63e-434e-9b6a-dd846b6b8db2]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:13 devstack sudo[88601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262
Apr 24 14:49:13 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:14 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262" returned: 0 in 0.592s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:14 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262
Apr 24 14:49:14 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:14 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd85c864-f0de-47e0-bddd-30e10a8e5262" returned: 0 in 0.469s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-cd85c864-f0de-47e0-bddd-30e10a8e5262" released by "delete_volume" :: held 1.103s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:14 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Created reservations ['055eea03-413b-484f-b664-0042802df3f9', '2a9dbac8-c03d-4322-9e04-5ae5a5a0c5d6', '7e4720ce-9af8-420f-916a-332c6cf867ac', '9d0684c1-12cf-4b43-beff-9195c130dcba'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:14 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:14 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:15 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.501s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:15 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:15 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Deleted volume successfully.
Apr 24 14:49:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-839a9363-73d2-4bb9-9615-d98ac9948b1a tempest-VolumesGetTest-693540363 None] Lock "cinder-cd85c864-f0de-47e0-bddd-30e10a8e5262-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-d8e2c61e-2900-4d07-a317-23803e17f2d9-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Lock "cinder-d8e2c61e-2900-4d07-a317-23803e17f2d9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-quobyte-d8e2c61e-2900-4d07-a317-23803e17f2d9" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-d8e2c61e-2900-4d07-a317-23803e17f2d9" acquired by "delete_volume" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:15 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cd27d1-f5c0-4bd5-ab93-5b600494407f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:15 devstack sudo[88613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9
Apr 24 14:49:15 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:16 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9" returned: 0 in 0.599s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:16 devstack sudo[88618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9
Apr 24 14:49:16 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:17 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-d8e2c61e-2900-4d07-a317-23803e17f2d9" returned: 0 in 0.537s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-d8e2c61e-2900-4d07-a317-23803e17f2d9" released by "delete_volume" :: held 1.179s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Created reservations ['42c5f3ea-5036-4499-acb6-e6450688ecfc', '7282d3e5-1e79-426e-827e-9a4d04b8d4ab', '478a5ba4-8fde-4269-bcf5-b5105f6d23a0', '1b46dbda-2e57-4a7d-9e59-3c09c4c8336a'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:17 devstack sudo[88621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:17 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:17 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.500s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:17 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Deleted volume successfully.
Apr 24 14:49:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c615f7d4-3961-4e94-bbb6-7b06c8d7afaf tempest-VolumesGetTest-693540363 None] Lock "cinder-d8e2c61e-2900-4d07-a317-23803e17f2d9-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (2d432472-ee6c-4931-b8b4-6eb0a2f039b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8f84a6-c012-4adb-a3d7-cd20b2ed1e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8f84a6-c012-4adb-a3d7-cd20b2ed1e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-464745424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63db82fd-3a58-4dab-8e27-0d2822407bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:18Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45293c4a-4a0f-4e7d-9a38-977438b00ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45293c4a-4a0f-4e7d-9a38-977438b00ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4aa5ce0-d5d0-45c8-8408-6430bfc99bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4aa5ce0-d5d0-45c8-8408-6430bfc99bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63db82fd-3a58-4dab-8e27-0d2822407bfd', 'volume_name': 'volume-63db82fd-3a58-4dab-8e27-0d2822407bfd', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd226c1-b0f9-4ba5-b952-83c7c306787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd226c1-b0f9-4ba5-b952-83c7c306787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3856f426-f610-4232-ac71-86625c000f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:18 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Volume 63db82fd-3a58-4dab-8e27-0d2822407bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63db82fd-3a58-4dab-8e27-0d2822407bfd', 'volume_size': 1}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-464745424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63db82fd-3a58-4dab-8e27-0d2822407bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:18Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Creating volume 63db82fd-3a58-4dab-8e27-0d2822407bfd {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:18 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:18 devstack sudo[88624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd 1073741824
Apr 24 14:49:18 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:19 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd 1073741824" returned: 0 in 0.652s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:19 devstack sudo[88629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd
Apr 24 14:49:19 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Flow 'volume_create_manager' (28bf6e22-1709-4245-b32d-d3f7a6f5d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c99d455-1c4c-4a30-bfb3-7d2050232729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c99d455-1c4c-4a30-bfb3-7d2050232729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1857446379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc12c4ab-a749-4e1b-b3b5-528c29356a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='367cf821513b456a8f51d53ca9b69e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:19Z,use_quota=True,user_id='b98722ee63e342498deac71f4b02eec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29df438e-ff69-42aa-8eb0-8f3bad7f150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29df438e-ff69-42aa-8eb0-8f3bad7f150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53010b39-8173-412b-bbb4-ee6154031dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53010b39-8173-412b-bbb4-ee6154031dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc12c4ab-a749-4e1b-b3b5-528c29356a40', 'volume_name': 'volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43242ec4-0172-4371-9461-6c909427436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43242ec4-0172-4371-9461-6c909427436c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4cadbf-b849-4034-b53e-20514711f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:19 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Volume cc12c4ab-a749-4e1b-b3b5-528c29356a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40', 'volume_size': 1}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:19 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd" returned: 0 in 0.447s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.264s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1857446379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc12c4ab-a749-4e1b-b3b5-528c29356a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='367cf821513b456a8f51d53ca9b69e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:19Z,use_quota=True,user_id='b98722ee63e342498deac71f4b02eec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Creating volume cc12c4ab-a749-4e1b-b3b5-528c29356a40 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:19 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3856f426-f610-4232-ac71-86625c000f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63db82fd-3a58-4dab-8e27-0d2822407bfd', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efd3a20-3b2c-49a7-b630-ad8284da405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:19 devstack sudo[88632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40 1073741824
Apr 24 14:49:19 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:19 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Volume volume-63db82fd-3a58-4dab-8e27-0d2822407bfd (63db82fd-3a58-4dab-8e27-0d2822407bfd): created successfully
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efd3a20-3b2c-49a7-b630-ad8284da405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (2d432472-ee6c-4931-b8b4-6eb0a2f039b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f33d68b0-e4fc-40f2-b662-dd3c0ed3402c tempest-VolumesGetTest-693540363 None] Created volume successfully.
Apr 24 14:49:20 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40 1073741824" returned: 0 in 0.591s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:20 devstack sudo[88637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40
Apr 24 14:49:20 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:20 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40" returned: 0 in 0.432s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4cadbf-b849-4034-b53e-20514711f10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032e4e8c-5367-4cf2-b522-4f572379b680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:20 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Volume volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40 (cc12c4ab-a749-4e1b-b3b5-528c29356a40): created successfully
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032e4e8c-5367-4cf2-b522-4f572379b680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Flow 'volume_create_manager' (28bf6e22-1709-4245-b32d-d3f7a6f5d415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:20 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4eb23c2c-2c29-4c51-b324-b36a39dd0a10 tempest-VolumesListAdminTestJSON-537161920 None] Created volume successfully.
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (18a47aae-a427-4e5e-815b-9aedb62b6b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c6b877-7c50-4fed-92f3-c7be700ca4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c6b877-7c50-4fed-92f3-c7be700ca4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1859864175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b281095f-ab49-43d0-868c-225aebbf39ac,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=63db82fd-3a58-4dab-8e27-0d2822407bfd,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:21Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291c2899-d476-4172-b143-533934a36d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291c2899-d476-4172-b143-533934a36d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7545937f-ef85-46ad-88b1-23b03691b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7545937f-ef85-46ad-88b1-23b03691b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b281095f-ab49-43d0-868c-225aebbf39ac', 'volume_name': 'volume-b281095f-ab49-43d0-868c-225aebbf39ac', 'volume_size': 1, 'source_volid': '63db82fd-3a58-4dab-8e27-0d2822407bfd', 'source_volstatus': 'available'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13183fc3-a0a9-4e01-9715-cd55fb404fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13183fc3-a0a9-4e01-9715-cd55fb404fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbe8977-87cb-48b7-ba29-467d41a52ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:20 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Volume b281095f-ab49-43d0-868c-225aebbf39ac: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b281095f-ab49-43d0-868c-225aebbf39ac', 'volume_size': 1, 'source_volid': '63db82fd-3a58-4dab-8e27-0d2822407bfd', 'source_volstatus': 'available'}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:20 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Cloning volume 63db82fd-3a58-4dab-8e27-0d2822407bfd to volume b281095f-ab49-43d0-868c-225aebbf39ac
Apr 24 14:49:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Creating offline snapshot 3793c0b8-0ee9-4d01-9c38-dd480bdc5441 of volume 63db82fd-3a58-4dab-8e27-0d2822407bfd {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e089bd92-2f9d-4fba-9d90-e6112a618e54]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:21 devstack sudo[88640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd
Apr 24 14:49:21 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:21 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd" returned: 0 in 0.560s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:21 devstack sudo[88645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441 1G
Apr 24 14:49:21 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Flow 'volume_create_manager' (f7618bc9-9859-4e4c-95c9-77113130a8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128c647f-8a36-4bb5-8026-9b3db4d8a463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128c647f-8a36-4bb5-8026-9b3db4d8a463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-804201639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9030e08c-7e1a-414e-8a05-a4624587aca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='367cf821513b456a8f51d53ca9b69e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:22Z,use_quota=True,user_id='b98722ee63e342498deac71f4b02eec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50229b4d-f672-45d6-942c-026248a7ebdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50229b4d-f672-45d6-942c-026248a7ebdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bf842e-96b6-4775-aab7-0a29306c58c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bf842e-96b6-4775-aab7-0a29306c58c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9030e08c-7e1a-414e-8a05-a4624587aca4', 'volume_name': 'volume-9030e08c-7e1a-414e-8a05-a4624587aca4', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4234aed3-7fbc-4653-a000-43bde15cb092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4234aed3-7fbc-4653-a000-43bde15cb092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859354e7-c851-406e-aa07-fa80ef4bde21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:21 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Volume 9030e08c-7e1a-414e-8a05-a4624587aca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9030e08c-7e1a-414e-8a05-a4624587aca4', 'volume_size': 1}
Apr 24 14:49:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:22 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441 1G" returned: 0 in 0.628s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63db82fd-3a58-4dab-8e27-0d2822407bfd -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:22 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63db82fd-3a58-4dab-8e27-0d2822407bfd -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441
Apr 24 14:49:22 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:22 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63db82fd-3a58-4dab-8e27-0d2822407bfd -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441" returned: 0 in 0.490s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:22 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441 is being set with open permissions: ugo+rw
Apr 24 14:49:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:22 devstack sudo[88656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441
Apr 24 14:49:22 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:23 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441" returned: 0 in 0.441s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:23 devstack sudo[88659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.info
Apr 24 14:49:23 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:23 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.info" returned: 0 in 0.457s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:23 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.info is being set with open permissions: ugo+rw
Apr 24 14:49:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:23 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.info
Apr 24 14:49:23 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:24 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.info" returned: 0 in 0.434s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-quobyte-b281095f-ab49-43d0-868c-225aebbf39ac" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-b281095f-ab49-43d0-868c-225aebbf39ac" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] snapshot: 3793c0b8-0ee9-4d01-9c38-dd480bdc5441, volume: b281095f-ab49-43d0-868c-225aebbf39ac,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[262d6f93-03e5-485d-acb7-cc9721008b24]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:24 devstack sudo[88699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441
Apr 24 14:49:24 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:24 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441" returned: 0 in 0.484s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63db82fd-3a58-4dab-8e27-0d2822407bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf931c6-d09f-490e-9cd5-9cc688b76ded]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:24 devstack sudo[88704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd
Apr 24 14:49:24 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:25 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd" returned: 0 in 0.510s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:25 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:49:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:25 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac
Apr 24 14:49:25 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:29 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac" returned: 0 in 4.502s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:29 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ffff06-3d22-4a92-bfc9-a9102d38809c]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:29 devstack sudo[88721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd
Apr 24 14:49:29 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:30 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd" returned: 0 in 0.618s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:30 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:49:30 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Converted 1024.00 MB image at 227.39 MB/s
Apr 24 14:49:30 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac is being set with open permissions: ugo+rw
Apr 24 14:49:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:30 devstack sudo[88726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac
Apr 24 14:49:30 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:30 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac" returned: 0 in 0.449s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-b281095f-ab49-43d0-868c-225aebbf39ac" released by "_copy_volume_from_snapshot" :: held 6.636s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-quobyte-3793c0b8-0ee9-4d01-9c38-dd480bdc5441" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-3793c0b8-0ee9-4d01-9c38-dd480bdc5441" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Deleting offline snapshot 3793c0b8-0ee9-4d01-9c38-dd480bdc5441 of volume 63db82fd-3a58-4dab-8e27-0d2822407bfd {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:49:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] snapshot_file for this snap is: volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:49:30 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3c79b1-30e0-4c70-afb4-8fd4627640fd]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:30 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441
Apr 24 14:49:30 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:31 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441" returned: 0 in 0.529s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:31 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63db82fd-3a58-4dab-8e27-0d2822407bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:49:31 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c65f97-5052-44db-b34f-5d7769709833]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:31 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd
Apr 24 14:49:31 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:31 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd" returned: 0 in 0.528s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:31 devstack sudo[88739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441
Apr 24 14:49:31 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:32 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441" returned: 0 in 0.549s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:32 devstack sudo[88745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441
Apr 24 14:49:32 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:32 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd.3793c0b8-0ee9-4d01-9c38-dd480bdc5441" returned: 0 in 0.435s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-3793c0b8-0ee9-4d01-9c38-dd480bdc5441" released by "_delete_snapshot" :: held 2.128s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.960s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.137s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-804201639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9030e08c-7e1a-414e-8a05-a4624587aca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='367cf821513b456a8f51d53ca9b69e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:22Z,use_quota=True,user_id='b98722ee63e342498deac71f4b02eec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Creating volume 9030e08c-7e1a-414e-8a05-a4624587aca4 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:32 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbe8977-87cb-48b7-ba29-467d41a52ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b281095f-ab49-43d0-868c-225aebbf39ac', 'volume_size': 1, 'source_volid': '63db82fd-3a58-4dab-8e27-0d2822407bfd', 'source_volstatus': 'available'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:32 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4 1073741824
Apr 24 14:49:32 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fdd4b1-34e8-4c57-89e0-9e0d50d715b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:32 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Volume volume-b281095f-ab49-43d0-868c-225aebbf39ac (b281095f-ab49-43d0-868c-225aebbf39ac): created successfully
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fdd4b1-34e8-4c57-89e0-9e0d50d715b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (18a47aae-a427-4e5e-815b-9aedb62b6b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:33 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-60bbbbab-a03f-4963-bdd6-702bdaa2b0b0 tempest-VolumesGetTest-693540363 None] Created volume successfully.
Apr 24 14:49:33 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4 1073741824" returned: 0 in 0.639s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:33 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4
Apr 24 14:49:33 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:34 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4" returned: 0 in 0.484s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859354e7-c851-406e-aa07-fa80ef4bde21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9030e08c-7e1a-414e-8a05-a4624587aca4', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f239ba74-ee62-47c0-ae84-34df92f3da1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:34 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Volume volume-9030e08c-7e1a-414e-8a05-a4624587aca4 (9030e08c-7e1a-414e-8a05-a4624587aca4): created successfully
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f239ba74-ee62-47c0-ae84-34df92f3da1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Flow 'volume_create_manager' (f7618bc9-9859-4e4c-95c9-77113130a8d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:34 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b04ca383-19bc-482f-a323-abd15c9c481d tempest-VolumesListAdminTestJSON-537161920 None] Created volume successfully.
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (35817360-7478-4939-8736-72b06a5dbaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fb891c-7e66-48eb-930a-ff35ba47ad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fb891c-7e66-48eb-930a-ff35ba47ad8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-691274649',display_name='tempest-VolumesGetTest-Volume-1339986422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d74b12-ee21-4b49-b17e-369adeeb174d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:34Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6980de0-c525-4893-bfc9-b2093e18ed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6980de0-c525-4893-bfc9-b2093e18ed32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2d2d07-b7bf-4ac3-8138-fbf4d0aef135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2d2d07-b7bf-4ac3-8138-fbf4d0aef135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d74b12-ee21-4b49-b17e-369adeeb174d', 'volume_name': 'volume-c9d74b12-ee21-4b49-b17e-369adeeb174d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc46ed36-3120-44bf-9a59-b92566d47741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc46ed36-3120-44bf-9a59-b92566d47741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051d2d7b-8610-491a-a30f-5a25242b2349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:34 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Volume c9d74b12-ee21-4b49-b17e-369adeeb174d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d74b12-ee21-4b49-b17e-369adeeb174d', 'volume_size': 1}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-691274649',display_name='tempest-VolumesGetTest-Volume-1339986422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d74b12-ee21-4b49-b17e-369adeeb174d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:34Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Creating volume c9d74b12-ee21-4b49-b17e-369adeeb174d {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:34 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:34 devstack sudo[88756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d 1073741824
Apr 24 14:49:34 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Flow 'volume_create_manager' (f4e298f6-0e0b-4de7-baff-ccab887f64d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3ee80b-ca56-45c2-b662-c09f543fb9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3ee80b-ca56-45c2-b662-c09f543fb9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1182108261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc690741-9330-46a6-ab19-12103bd8fdb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='367cf821513b456a8f51d53ca9b69e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:35Z,use_quota=True,user_id='b98722ee63e342498deac71f4b02eec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6f6229-bd47-4e07-a841-dde544dc8d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6f6229-bd47-4e07-a841-dde544dc8d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6b30fd-91a8-4b92-a8d9-9e4ba50c5dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6b30fd-91a8-4b92-a8d9-9e4ba50c5dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc690741-9330-46a6-ab19-12103bd8fdb4', 'volume_name': 'volume-cc690741-9330-46a6-ab19-12103bd8fdb4', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa0b01b-17c2-47cb-843a-3a2c56116448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa0b01b-17c2-47cb-843a-3a2c56116448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0007ad0-d041-4022-b031-3bde410e94d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:35 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Volume cc690741-9330-46a6-ab19-12103bd8fdb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc690741-9330-46a6-ab19-12103bd8fdb4', 'volume_size': 1}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:35 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d 1073741824" returned: 0 in 0.708s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:35 devstack sudo[88761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d
Apr 24 14:49:35 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:35 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d" returned: 0 in 0.447s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1182108261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc690741-9330-46a6-ab19-12103bd8fdb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='367cf821513b456a8f51d53ca9b69e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:35Z,use_quota=True,user_id='b98722ee63e342498deac71f4b02eec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Creating volume cc690741-9330-46a6-ab19-12103bd8fdb4 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:35 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051d2d7b-8610-491a-a30f-5a25242b2349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d74b12-ee21-4b49-b17e-369adeeb174d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e854912e-d26f-4c98-99af-67131ad8dc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:35 devstack sudo[88764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4 1073741824
Apr 24 14:49:35 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:35 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Volume volume-c9d74b12-ee21-4b49-b17e-369adeeb174d (c9d74b12-ee21-4b49-b17e-369adeeb174d): created successfully
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e854912e-d26f-4c98-99af-67131ad8dc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (35817360-7478-4939-8736-72b06a5dbaa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:35 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ee7fe3e0-ff1c-40f7-a4f2-a03963e40d24 tempest-VolumesGetTest-693540363 None] Created volume successfully.
Apr 24 14:49:36 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4 1073741824" returned: 0 in 0.619s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:36 devstack sudo[88769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4
Apr 24 14:49:36 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-c9d74b12-ee21-4b49-b17e-369adeeb174d-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Lock "cinder-c9d74b12-ee21-4b49-b17e-369adeeb174d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-quobyte-c9d74b12-ee21-4b49-b17e-369adeeb174d" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-c9d74b12-ee21-4b49-b17e-369adeeb174d" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee2d608-eeb0-43e2-a346-2b0fcc87e3c3]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:36 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4" returned: 0 in 0.456s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0007ad0-d041-4022-b031-3bde410e94d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc690741-9330-46a6-ab19-12103bd8fdb4', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035852e0-0304-4237-ab1c-d02c7bdb06fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:36 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Volume volume-cc690741-9330-46a6-ab19-12103bd8fdb4 (cc690741-9330-46a6-ab19-12103bd8fdb4): created successfully
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035852e0-0304-4237-ab1c-d02c7bdb06fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:36 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Flow 'volume_create_manager' (f4e298f6-0e0b-4de7-baff-ccab887f64d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:36 devstack sudo[88772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d
Apr 24 14:49:36 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:36 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-fdde2256-3686-4857-9b5e-839f58708557 tempest-VolumesListAdminTestJSON-537161920 None] Created volume successfully.
Apr 24 14:49:37 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d" returned: 0 in 0.612s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:37 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d
Apr 24 14:49:37 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Flow 'volume_create_manager' (fcb3f775-9fd1-494a-a3a7-d5f2f6510ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb927c9-20ec-4666-b597-a21c14c296c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb927c9-20ec-4666-b597-a21c14c296c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb1f492-6ab7-46bd-ae22-3026a90cebda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb7f306f37944f9965bb5dd6500b92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:38Z,use_quota=True,user_id='041d9e7272354fe6894ea96e5168d0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b841736-72f7-4288-a0a5-af1d2d344e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b841736-72f7-4288-a0a5-af1d2d344e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ac22af-1789-4d25-81fb-1f7580494b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ac22af-1789-4d25-81fb-1f7580494b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb1f492-6ab7-46bd-ae22-3026a90cebda', 'volume_name': 'volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82cfb779-bca1-4ecb-b609-b27795f731df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82cfb779-bca1-4ecb-b609-b27795f731df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89d5c3b-003d-421b-b574-45db43c2542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:37 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Volume ccb1f492-6ab7-46bd-ae22-3026a90cebda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda', 'volume_size': 1}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb1f492-6ab7-46bd-ae22-3026a90cebda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb7f306f37944f9965bb5dd6500b92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:38Z,use_quota=True,user_id='041d9e7272354fe6894ea96e5168d0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Creating volume ccb1f492-6ab7-46bd-ae22-3026a90cebda {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:37 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:37 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda 1073741824
Apr 24 14:49:37 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:37 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c9d74b12-ee21-4b49-b17e-369adeeb174d" returned: 0 in 0.521s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-c9d74b12-ee21-4b49-b17e-369adeeb174d" released by "delete_volume" :: held 1.181s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:37 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Created reservations ['50b5bf22-5586-4343-ac27-007a2aa1f010', '328ca9ea-ee73-47ef-b609-fc7724d641b9', '04c9e541-c3c9-4d38-8a03-20ab55bddae0', 'c0aebe00-c6f5-47ff-aae1-7d3b7cf0e098'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:38 devstack sudo[88782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:38 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:38 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda 1073741824" returned: 0 in 0.622s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:38 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda
Apr 24 14:49:38 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:38 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.485s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:38 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Deleted volume successfully.
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ad594f5d-aa12-41bc-9086-d8cf16425dcb tempest-VolumesGetTest-693540363 None] Lock "cinder-c9d74b12-ee21-4b49-b17e-369adeeb174d-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:38 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda" returned: 0 in 0.463s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89d5c3b-003d-421b-b574-45db43c2542c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46f7dbb-b308-4804-b648-35fbd65cf219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-b281095f-ab49-43d0-868c-225aebbf39ac-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Lock "cinder-b281095f-ab49-43d0-868c-225aebbf39ac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:38 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Volume volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda (ccb1f492-6ab7-46bd-ae22-3026a90cebda): created successfully
Apr 24 14:49:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46f7dbb-b308-4804-b648-35fbd65cf219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Flow 'volume_create_manager' (fcb3f775-9fd1-494a-a3a7-d5f2f6510ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:39 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ac1ac95a-b6ee-429e-b21d-547361763d6f tempest-VolumesListAdminTestJSON-737746332 None] Created volume successfully.
Apr 24 14:49:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-quobyte-b281095f-ab49-43d0-868c-225aebbf39ac" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-b281095f-ab49-43d0-868c-225aebbf39ac" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:39 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2027bb6b-f37e-4484-8300-84835c0639ee]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:39 devstack sudo[88791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac
Apr 24 14:49:39 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:39 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac" returned: 0 in 0.500s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:39 devstack sudo[88796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac
Apr 24 14:49:39 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Acquiring lock "cinder-ccb1f492-6ab7-46bd-ae22-3026a90cebda-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Lock "cinder-ccb1f492-6ab7-46bd-ae22-3026a90cebda-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Acquiring lock "cinder-quobyte-ccb1f492-6ab7-46bd-ae22-3026a90cebda" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Lock "cinder-quobyte-ccb1f492-6ab7-46bd-ae22-3026a90cebda" acquired by "delete_volume" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e7581e-96d7-405c-ba1a-e1e3a2e7a0a9]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:40 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "cinder-cc690741-9330-46a6-ab19-12103bd8fdb4-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b281095f-ab49-43d0-868c-225aebbf39ac" returned: 0 in 0.534s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-b281095f-ab49-43d0-868c-225aebbf39ac" released by "delete_volume" :: held 1.083s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-cc690741-9330-46a6-ab19-12103bd8fdb4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:40 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda
Apr 24 14:49:40 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "cinder-quobyte-cc690741-9330-46a6-ab19-12103bd8fdb4" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Created reservations ['511d3bc6-143e-4476-9dd3-858dce4cbb1c', '2753e251-1dd2-4a51-8e66-6c530d8b6107', '4aa6a6b2-13e4-4937-8e8c-27836c26e239', '2b5aa64a-bd0d-4f67-9819-448dfba88bae'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-quobyte-cc690741-9330-46a6-ab19-12103bd8fdb4" acquired by "delete_volume" :: waited 0.028s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3916141-fa36-476a-b4fd-d473f6ed70c5]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:40 devstack sudo[88801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4
Apr 24 14:49:40 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:40 devstack sudo[88802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:40 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:40 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda" returned: 0 in 0.559s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:40 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda
Apr 24 14:49:40 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:40 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.477s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:40 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Deleted volume successfully.
Apr 24 14:49:40 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4" returned: 0 in 0.562s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f5a11aca-2fad-4869-b5cf-2907f776c733 tempest-VolumesGetTest-693540363 None] Lock "cinder-b281095f-ab49-43d0-868c-225aebbf39ac-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:40 devstack sudo[88814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4
Apr 24 14:49:40 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:41 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ccb1f492-6ab7-46bd-ae22-3026a90cebda" returned: 0 in 0.471s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Lock "cinder-quobyte-ccb1f492-6ab7-46bd-ae22-3026a90cebda" released by "delete_volume" :: held 1.078s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Created reservations ['13402be5-4bf8-4c03-80f7-a2908384a22b', '9f3adb7e-8315-49a3-bea8-b752185e5167', '7075bff0-7d9c-4329-a331-1acc734eea52', 'd2a9f4b8-4702-4c45-8072-c3d9f31b6614'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:41 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:41 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-63db82fd-3a58-4dab-8e27-0d2822407bfd-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Lock "cinder-63db82fd-3a58-4dab-8e27-0d2822407bfd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:41 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc690741-9330-46a6-ab19-12103bd8fdb4" returned: 0 in 0.538s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-quobyte-cc690741-9330-46a6-ab19-12103bd8fdb4" released by "delete_volume" :: held 1.145s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-quobyte-63db82fd-3a58-4dab-8e27-0d2822407bfd" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-63db82fd-3a58-4dab-8e27-0d2822407bfd" acquired by "delete_volume" :: waited 0.030s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b526f0-c7f9-465d-85e1-0885298a9346]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Created reservations ['95f2056c-a407-4fba-9783-8ae04a773529', 'a7d5d20b-885c-454f-bd38-f0cedddf754c', 'c1de2aba-f2b3-41a4-9000-b1c8790b320b', '58924c21-d004-4e94-bba9-05ddde8f235a'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:41 devstack sudo[88820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd
Apr 24 14:49:41 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:41 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:41 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:41 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.515s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:41 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Deleted volume successfully.
Apr 24 14:49:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ec4bf895-16e6-46f3-8bc1-3a5a6a051e54 tempest-VolumesListAdminTestJSON-737746332 None] Lock "cinder-ccb1f492-6ab7-46bd-ae22-3026a90cebda-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:42 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd" returned: 0 in 0.574s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:42 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.488s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:42 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Deleted volume successfully.
Apr 24 14:49:42 devstack sudo[88829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd
Apr 24 14:49:42 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e39705b2-3070-4bce-b7d4-b667e516969f tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-cc690741-9330-46a6-ab19-12103bd8fdb4-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "cinder-9030e08c-7e1a-414e-8a05-a4624587aca4-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-9030e08c-7e1a-414e-8a05-a4624587aca4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "cinder-quobyte-9030e08c-7e1a-414e-8a05-a4624587aca4" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-quobyte-9030e08c-7e1a-414e-8a05-a4624587aca4" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f11564-38a3-41f2-ab17-54433fd6500d]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:42 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-63db82fd-3a58-4dab-8e27-0d2822407bfd" returned: 0 in 0.506s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-63db82fd-3a58-4dab-8e27-0d2822407bfd" released by "delete_volume" :: held 1.136s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:42 devstack sudo[88833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4
Apr 24 14:49:42 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Created reservations ['4374743e-2729-4d0d-a16c-8360ef574cb8', '3335f6c2-aa30-45f5-8139-5c4764f86cdc', 'b54575a2-ce4a-41f4-93d9-d2a3dfff5aeb', 'b712291c-6c2e-436d-a1c5-72e719c255be'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:42 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:42 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:43 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4" returned: 0 in 0.587s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:43 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4
Apr 24 14:49:43 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:43 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.530s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Deleted volume successfully.
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7a7ddbd-8982-45f7-82a1-8853fc58dedc tempest-VolumesGetTest-693540363 None] Lock "cinder-63db82fd-3a58-4dab-8e27-0d2822407bfd-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:43 devstack sudo[88843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:43 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (8913c312-60f1-461f-ab1a-cc1718f06c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7587e49-6838-4065-897f-7106936746f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7587e49-6838-4065-897f-7106936746f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1888497238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce8755a-2465-40cb-9bc5-25f564eca717,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:43Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e19553-314e-47f1-a51c-6c3885ebc7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e19553-314e-47f1-a51c-6c3885ebc7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc707a2e-a7f6-4c97-a924-cc661c274285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.image.glance [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Creating Keystone auth plugin from conf {{(pid=81510) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 24 14:49:43 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-9030e08c-7e1a-414e-8a05-a4624587aca4" returned: 0 in 0.500s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-quobyte-9030e08c-7e1a-414e-8a05-a4624587aca4" released by "delete_volume" :: held 1.131s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Created reservations ['77e5da61-e6b5-4c9c-b973-57798403d987', '296ce83e-efe2-4963-9ec1-0bed20b28951', '677f1bec-7d7f-48a2-b0ab-eb7f2aceb4d6', '75ba1b73-1b71-4d59-ad75-b9d711fc3550'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:43 devstack sudo[88846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:43 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc707a2e-a7f6-4c97-a924-cc661c274285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fce8755a-2465-40cb-9bc5-25f564eca717', 'volume_name': 'volume-fce8755a-2465-40cb-9bc5-25f564eca717', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed7331480>}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99d0974-c287-42fd-932c-e53758c61426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99d0974-c287-42fd-932c-e53758c61426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc0a6e4-3873-4854-ab39-59abd68a6ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:43 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Volume fce8755a-2465-40cb-9bc5-25f564eca717: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fce8755a-2465-40cb-9bc5-25f564eca717', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed7331480>}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Trying to clone fce8755a-2465-40cb-9bc5-25f564eca717 from image 30506e97-0d47-4b1b-9d4d-f76757b4246f at location (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]). {{(pid=81510) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 24 14:49:43 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.548s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:43 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:44 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 24 14:49:44 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Image download 20.69 MB at 20.69 MB/s
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.486s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:44 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Deleted volume successfully.
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c8d5a5-32e2-4c4e-8033-6e101d31c620]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6744cda0-34cf-4af9-9d3d-72b5e2bd57d6 tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-9030e08c-7e1a-414e-8a05-a4624587aca4-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:44 devstack sudo[88851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD
Apr 24 14:49:44 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "cinder-cc12c4ab-a749-4e1b-b3b5-528c29356a40-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-cc12c4ab-a749-4e1b-b3b5-528c29356a40-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "cinder-quobyte-cc12c4ab-a749-4e1b-b3b5-528c29356a40" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-quobyte-cc12c4ab-a749-4e1b-b3b5-528c29356a40" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba2ee9c-2a2a-4e93-848e-cc39a1bf4040]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:44 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD" returned: 0 in 0.528s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Temporary image 30506e97-0d47-4b1b-9d4d-f76757b4246f is fetched for user 71e60d0fffe143599ae8f365693f351b. {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 24 14:49:44 devstack sudo[88856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40
Apr 24 14:49:44 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e397aa-7d06-453f-9d57-1929672f4ed4]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:44 devstack sudo[88858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD
Apr 24 14:49:44 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:45 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40" returned: 0 in 0.599s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:45 devstack sudo[88867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40
Apr 24 14:49:45 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:45 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD" returned: 0 in 0.583s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1888497238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce8755a-2465-40cb-9bc5-25f564eca717,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:43Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Creating volume fce8755a-2465-40cb-9bc5-25f564eca717 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:45 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:45 devstack sudo[88869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 1073741824
Apr 24 14:49:45 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:45 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cc12c4ab-a749-4e1b-b3b5-528c29356a40" returned: 0 in 0.465s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-quobyte-cc12c4ab-a749-4e1b-b3b5-528c29356a40" released by "delete_volume" :: held 1.102s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:45 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Created reservations ['cf709dcc-e7ab-4f2c-9c61-fc65f603d9ba', '7feee6a7-d0d3-4f6a-a624-f22e50dfd086', '2e1941e4-2088-4ad2-a3f8-9e109f8968f1', '9e083948-5177-4d29-884f-00f25a2ec1de'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:46 devstack sudo[88875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:46 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:46 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 1073741824" returned: 0 in 0.672s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:46 devstack sudo[88877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717
Apr 24 14:49:46 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:46 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.487s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:46 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Deleted volume successfully.
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-dcba35c1-4552-4504-a012-936961da7e8f tempest-VolumesListAdminTestJSON-537161920 None] Lock "cinder-cc12c4ab-a749-4e1b-b3b5-528c29356a40-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:46 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717" returned: 0 in 0.516s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Attempting download of 30506e97-0d47-4b1b-9d4d-f76757b4246f ((None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}])) to volume fce8755a-2465-40cb-9bc5-25f564eca717. {{(pid=81510) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f3bf03-8dfe-497d-96ca-e9d2bbbb255e]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_og9_7rv3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:46 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_og9_7rv3
Apr 24 14:49:46 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:47 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_og9_7rv3" returned: 0 in 0.546s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_og9_7rv3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:47 devstack sudo[88885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_og9_7rv3
Apr 24 14:49:47 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:47 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_og9_7rv3" returned: 1 in 0.589s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30506e97-0d47-4b1b-9d4d-f76757b4246f_og9_7rv3' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:49:47 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[194cb4b5-4ba3-4b5e-b7b4-59d49d78dbf0]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:48 devstack sudo[88889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD
Apr 24 14:49:48 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:48 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD" returned: 0 in 0.604s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:48 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] 30506e97-0d47-4b1b-9d4d-f76757b4246f was qcow2, converting to raw {{(pid=81510) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 24 14:49:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:48 devstack sudo[88895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717
Apr 24 14:49:48 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:49 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717" returned: 0 in 1.421s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:49 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30506e97-0d47-4b1b-9d4d-f76757b4246f_h32yb0h0devstack@QuobyteHD, size 112.00 MB, duration 1.42 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:49:49 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Converted 112.00 MB image at 78.74 MB/s
Apr 24 14:49:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:49 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 1G
Apr 24 14:49:49 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:50 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 1G" returned: 0 in 0.524s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:50 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cdf069-7f89-4cbd-b91c-39dad982c43f]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:50 devstack sudo[88914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717
Apr 24 14:49:50 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:51 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717" returned: 0 in 0.630s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:51 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717
Apr 24 14:49:51 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:51 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717" returned: 1 in 0.603s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Downloaded image 30506e97-0d47-4b1b-9d4d-f76757b4246f ((None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}])) to volume fce8755a-2465-40cb-9bc5-25f564eca717 successfully. {{(pid=81510) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Temporary image 30506e97-0d47-4b1b-9d4d-f76757b4246f for user 71e60d0fffe143599ae8f365693f351b is deleted. {{(pid=81510) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG cinder.volume.volume_utils [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Marking volume fce8755a-2465-40cb-9bc5-25f564eca717 as bootable. {{(pid=81510) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:UPDATE=144,cinder:SELECT=106,cinder:INSERT=33,cinder:DELETE=9 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Copying metadata from image 30506e97-0d47-4b1b-9d4d-f76757b4246f to fce8755a-2465-40cb-9bc5-25f564eca717. {{(pid=81510) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Creating volume glance metadata for volume fce8755a-2465-40cb-9bc5-25f564eca717 backed by image 30506e97-0d47-4b1b-9d4d-f76757b4246f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81510) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=89,cinder:INSERT=35,cinder:UPDATE=147,cinder:DELETE=16 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc0a6e4-3873-4854-ab39-59abd68a6ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fce8755a-2465-40cb-9bc5-25f564eca717', 'volume_size': 1, 'image_id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30506e97-0d47-4b1b-9d4d-f76757b4246f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a2419f1cec24635bfbec208d1a49920', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30506e97-0d47-4b1b-9d4d-f76757b4246f', 'created_at': datetime.datetime(2026, 4, 24, 12, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 12, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30506e97-0d47-4b1b-9d4d-f76757b4246f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ed7331480>}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297fe0d2-d357-4b45-9cc7-01f4a95a3a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:51 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Volume volume-fce8755a-2465-40cb-9bc5-25f564eca717 (fce8755a-2465-40cb-9bc5-25f564eca717): created successfully
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297fe0d2-d357-4b45-9cc7-01f4a95a3a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (8913c312-60f1-461f-ab1a-cc1718f06c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:51 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-57416061-8e67-4a96-9f6e-bc0346feb1e6 tempest-VolumesGetTest-693540363 None] Created volume successfully.
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (3ca41e45-2da9-4a23-bf91-ae2092fbce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4093cd-f521-4c7b-b7b4-c69824b43701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4093cd-f521-4c7b-b7b4-c69824b43701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-917569343',display_name='tempest-VolumesGetTest-Volume-1599500029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8424e6-ccdd-4f2c-81bf-cec16deefb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:54Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea89dc6-d1a0-49e4-b7b0-557073c2e4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea89dc6-d1a0-49e4-b7b0-557073c2e4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9232c1a-0f44-423a-b530-739753f5bf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9232c1a-0f44-423a-b530-739753f5bf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8424e6-ccdd-4f2c-81bf-cec16deefb22', 'volume_name': 'volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc6d3fd-7acf-40f2-9e0e-96e9e26b2f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc6d3fd-7acf-40f2-9e0e-96e9e26b2f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc8e23b-c6a0-4488-9dab-86eb9c099c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:53 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Volume 4f8424e6-ccdd-4f2c-81bf-cec16deefb22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22', 'volume_size': 1}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-917569343',display_name='tempest-VolumesGetTest-Volume-1599500029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8424e6-ccdd-4f2c-81bf-cec16deefb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea96b329fae44c499fba040ae45cb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:54Z,use_quota=True,user_id='71e60d0fffe143599ae8f365693f351b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Creating volume 4f8424e6-ccdd-4f2c-81bf-cec16deefb22 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:53 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:53 devstack sudo[88931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22 1073741824
Apr 24 14:49:53 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:54 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22 1073741824" returned: 0 in 0.652s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:54 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22
Apr 24 14:49:54 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:54 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22" returned: 0 in 0.477s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc8e23b-c6a0-4488-9dab-86eb9c099c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9087534e-0194-45ed-8a56-d742bfe979cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:54 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Volume volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22 (4f8424e6-ccdd-4f2c-81bf-cec16deefb22): created successfully
Apr 24 14:49:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9087534e-0194-45ed-8a56-d742bfe979cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Flow 'volume_create_manager' (3ca41e45-2da9-4a23-bf91-ae2092fbce4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2bc27483-d695-4917-9964-743f9cee5ab3 tempest-VolumesGetTest-693540363 None] Created volume successfully.
Apr 24 14:49:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-4f8424e6-ccdd-4f2c-81bf-cec16deefb22-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Lock "cinder-4f8424e6-ccdd-4f2c-81bf-cec16deefb22-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-quobyte-4f8424e6-ccdd-4f2c-81bf-cec16deefb22" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-4f8424e6-ccdd-4f2c-81bf-cec16deefb22" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[902e3a9e-2e76-415b-885f-39b42a152506]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:56 devstack sudo[88939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22
Apr 24 14:49:56 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:49:56 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Flow 'volume_create_manager' (9b301a1d-9e98-4898-9c86-8530435b6234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1739e4ea-3fae-47f8-999c-5ec709dce87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22" returned: 0 in 0.594s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1739e4ea-3fae-47f8-999c-5ec709dce87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1421233366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573ca922-4e98-43fb-962f-0985779af04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85d553038f4f52a74a7c732ee4d254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:57Z,use_quota=True,user_id='fffd1d6efbec424fa228ad94450f5734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:56 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22
Apr 24 14:49:56 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35353ce0-ecae-4017-912c-5c56aa363457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35353ce0-ecae-4017-912c-5c56aa363457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8767742d-96f7-4ab1-8867-67525de28c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8767742d-96f7-4ab1-8867-67525de28c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '573ca922-4e98-43fb-962f-0985779af04c', 'volume_name': 'volume-573ca922-4e98-43fb-962f-0985779af04c', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095ee751-3c5c-4ca6-be37-75d82af8041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095ee751-3c5c-4ca6-be37-75d82af8041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988f3ff2-fe55-4ec8-94ba-971ec258b39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:56 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Volume 573ca922-4e98-43fb-962f-0985779af04c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-573ca922-4e98-43fb-962f-0985779af04c', 'volume_size': 1}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1421233366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573ca922-4e98-43fb-962f-0985779af04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85d553038f4f52a74a7c732ee4d254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:49:57Z,use_quota=True,user_id='fffd1d6efbec424fa228ad94450f5734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Creating volume 573ca922-4e98-43fb-962f-0985779af04c {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:49:56 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:49:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:56 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c 1073741824
Apr 24 14:49:56 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:57 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f8424e6-ccdd-4f2c-81bf-cec16deefb22" returned: 0 in 0.461s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-4f8424e6-ccdd-4f2c-81bf-cec16deefb22" released by "delete_volume" :: held 1.098s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Created reservations ['c7bc3264-e1b8-4117-8b2a-0a35ce21b186', 'f74dd087-ad39-4e38-85e0-afbe01e9da5e', '7caab71c-4f20-4948-a3b6-2b3e2691080b', '404ccaf0-836f-4c25-a338-bb578320fdf5'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:57 devstack sudo[88952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:49:57 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:57 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c 1073741824" returned: 0 in 0.626s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:57 devstack sudo[88954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c
Apr 24 14:49:57 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:57 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.451s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:49:57 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Deleted volume successfully.
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-0d28815b-de72-4815-ac70-adc271be3837 tempest-VolumesGetTest-693540363 None] Lock "cinder-4f8424e6-ccdd-4f2c-81bf-cec16deefb22-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:57 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c" returned: 0 in 0.457s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988f3ff2-fe55-4ec8-94ba-971ec258b39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-573ca922-4e98-43fb-962f-0985779af04c', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450514c3-31b7-43dd-bbf6-b15f898a2761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:49:57 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Volume volume-573ca922-4e98-43fb-962f-0985779af04c (573ca922-4e98-43fb-962f-0985779af04c): created successfully
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450514c3-31b7-43dd-bbf6-b15f898a2761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:49:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Flow 'volume_create_manager' (9b301a1d-9e98-4898-9c86-8530435b6234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:49:57 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-8a53a566-a8e2-4e23-bea4-cec7bcc85deb tempest-VolumesTransfersV357Test-1611914488 None] Created volume successfully.
Apr 24 14:49:58 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-fce8755a-2465-40cb-9bc5-25f564eca717-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:58 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Lock "cinder-fce8755a-2465-40cb-9bc5-25f564eca717-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:58 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Acquiring lock "cinder-quobyte-fce8755a-2465-40cb-9bc5-25f564eca717" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:49:58 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-fce8755a-2465-40cb-9bc5-25f564eca717" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:49:58 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc9804b-4408-4a59-a2e3-de8cdd31c0e4]: (4, 'raw') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:49:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:58 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717
Apr 24 14:49:58 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:58 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717" returned: 0 in 0.541s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:58 devstack sudo[88962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717
Apr 24 14:49:58 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:59 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-5e1b3809-ce21-43ee-a494-17692674d61a tempest-VolumesTransfersV357Test-1701276121 None] Transfer volume completed successfully.
Apr 24 14:49:59 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717" returned: 1 in 0.550s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717' failed. Not Retrying. {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 24 14:49:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:49:59 devstack sudo[88967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717
Apr 24 14:49:59 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:49:59 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root
Apr 24 14:49:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fce8755a-2465-40cb-9bc5-25f564eca717" returned: 0 in 0.451s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:49:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Lock "cinder-quobyte-fce8755a-2465-40cb-9bc5-25f564eca717" released by "delete_volume" :: held 1.602s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:49:59 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Created reservations ['3fdf457d-e640-4d6e-a0b5-fd2a6b347151', 'd3c6a568-107d-4cd8-a80f-11e2cfc1afc8', '44b8a7c5-deb5-4441-87a5-873fbd962c5f', 'efbe8691-1c3c-48e9-858a-3295688aa449'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:49:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:49:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:49:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:00 devstack sudo[88970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:50:00 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Acquiring lock "cinder-573ca922-4e98-43fb-962f-0985779af04c-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Lock "cinder-573ca922-4e98-43fb-962f-0985779af04c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Acquiring lock "cinder-quobyte-573ca922-4e98-43fb-962f-0985779af04c" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Lock "cinder-quobyte-573ca922-4e98-43fb-962f-0985779af04c" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3cfae0-43eb-4ed7-83f5-2aba7f5e9fbc]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:00 devstack sudo[88972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c
Apr 24 14:50:00 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:00 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.480s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:50:00 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Deleted volume successfully.
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7bbc8052-c0c5-476e-afa7-e5561cc77636 tempest-VolumesGetTest-693540363 None] Lock "cinder-fce8755a-2465-40cb-9bc5-25f564eca717-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:00 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c" returned: 0 in 0.574s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:00 devstack sudo[88978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c
Apr 24 14:50:00 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:01 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-573ca922-4e98-43fb-962f-0985779af04c" returned: 0 in 0.505s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:01 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Lock "cinder-quobyte-573ca922-4e98-43fb-962f-0985779af04c" released by "delete_volume" :: held 1.119s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:01 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Created reservations ['b266e192-d4cd-409a-8173-83d44e5f50dc', '75818034-3837-48c3-9549-f6223ebe4b03', 'ddd53ef3-38d7-4f15-9076-1cbbbc902e88', '633f6a45-0964-460d-9ede-6f081bc68c74'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:50:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:01 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:50:01 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:02 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.510s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:50:02 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Deleted volume successfully.
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f7850783-4e65-497c-ad3f-2356ad64df1b tempest-VolumesTransfersV357Test-127643786 None] Lock "cinder-573ca922-4e98-43fb-962f-0985779af04c-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Flow 'volume_create_manager' (28f0da88-d47e-4b3c-917f-fbe28ed8c89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadfa6bf-6bc9-49dc-8467-263a361b9815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadfa6bf-6bc9-49dc-8467-263a361b9815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1269325823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7729cb-5710-4a8c-ad6a-361bb04b2887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85d553038f4f52a74a7c732ee4d254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:03Z,use_quota=True,user_id='fffd1d6efbec424fa228ad94450f5734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acccb46d-565f-486b-8ec1-607e19ac9579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acccb46d-565f-486b-8ec1-607e19ac9579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e02a472-dcc8-4e2d-840d-67d71376d69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e02a472-dcc8-4e2d-840d-67d71376d69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f7729cb-5710-4a8c-ad6a-361bb04b2887', 'volume_name': 'volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75ebdfa-b6a3-43db-9d81-0446d1a730f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75ebdfa-b6a3-43db-9d81-0446d1a730f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3850bf0d-c919-433f-8fb9-b6aa0d5b8ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:02 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Volume 4f7729cb-5710-4a8c-ad6a-361bb04b2887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887', 'volume_size': 1}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1269325823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7729cb-5710-4a8c-ad6a-361bb04b2887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e85d553038f4f52a74a7c732ee4d254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:03Z,use_quota=True,user_id='fffd1d6efbec424fa228ad94450f5734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Creating volume 4f7729cb-5710-4a8c-ad6a-361bb04b2887 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:50:02 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:02 devstack sudo[88987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887 1073741824
Apr 24 14:50:02 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Flow 'volume_create_manager' (941927b1-0ba0-4def-bb43-31a198aafca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d9de1b-b8f0-44b2-ac6a-6849ee10c848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d9de1b-b8f0-44b2-ac6a-6849ee10c848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-540480474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ae0acd-fa55-45c0-bc27-2b468456cba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12cb4d7573824bbca8b9b470fe306b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:03Z,use_quota=True,user_id='1ef9666a18c54a5fb6e031ec91765075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e7eccc-9756-4a48-a401-4fdf226d7180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e7eccc-9756-4a48-a401-4fdf226d7180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96b8047-5d63-4ea1-b96d-9bfb44fee679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96b8047-5d63-4ea1-b96d-9bfb44fee679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ae0acd-fa55-45c0-bc27-2b468456cba6', 'volume_name': 'volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523fa6dc-4774-4ad1-8368-faee7769f5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523fa6dc-4774-4ad1-8368-faee7769f5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:03 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277dbe1b-7ccc-4033-ba93-14a9f4672367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:03 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Volume c0ae0acd-fa55-45c0-bc27-2b468456cba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6', 'volume_size': 1}
Apr 24 14:50:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:03 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887 1073741824" returned: 0 in 0.643s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:03 devstack sudo[88992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887
Apr 24 14:50:03 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:04 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887" returned: 0 in 0.439s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-540480474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ae0acd-fa55-45c0-bc27-2b468456cba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12cb4d7573824bbca8b9b470fe306b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:03Z,use_quota=True,user_id='1ef9666a18c54a5fb6e031ec91765075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Creating volume c0ae0acd-fa55-45c0-bc27-2b468456cba6 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:50:04 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3850bf0d-c919-433f-8fb9-b6aa0d5b8ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:04 devstack sudo[88995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 1073741824
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ae0b51-4a80-4129-8b0f-b62c95336270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:04 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:04 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Volume volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887 (4f7729cb-5710-4a8c-ad6a-361bb04b2887): created successfully
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ae0b51-4a80-4129-8b0f-b62c95336270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Flow 'volume_create_manager' (28f0da88-d47e-4b3c-917f-fbe28ed8c89c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:04 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c50d19a4-b17f-48f1-89ce-0e0f0eb29dc9 tempest-VolumesTransfersV357Test-1611914488 None] Created volume successfully.
Apr 24 14:50:04 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 1073741824" returned: 0 in 0.585s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:04 devstack sudo[89000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6
Apr 24 14:50:04 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:05 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6" returned: 0 in 0.466s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277dbe1b-7ccc-4033-ba93-14a9f4672367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffe9457-bf2d-42ec-9e37-0e42197f525c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:05 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Volume volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 (c0ae0acd-fa55-45c0-bc27-2b468456cba6): created successfully
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffe9457-bf2d-42ec-9e37-0e42197f525c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Flow 'volume_create_manager' (941927b1-0ba0-4def-bb43-31a198aafca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:05 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-9c0d6d3d-b4c9-4db5-acb6-f06226180594 tempest-VolumeDependencyTests-1905798628 None] Created volume successfully.
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Acquiring lock "cinder-4f7729cb-5710-4a8c-ad6a-361bb04b2887-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Lock "cinder-4f7729cb-5710-4a8c-ad6a-361bb04b2887-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Acquiring lock "cinder-quobyte-4f7729cb-5710-4a8c-ad6a-361bb04b2887" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Lock "cinder-quobyte-4f7729cb-5710-4a8c-ad6a-361bb04b2887" acquired by "delete_volume" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb6136f-0346-4d38-9516-dc365286ac36]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:05 devstack sudo[89003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887
Apr 24 14:50:05 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:05 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887" returned: 0 in 0.522s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:05 devstack sudo[89008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887
Apr 24 14:50:05 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] Creating offline snapshot 654f7ca9-f4e2-4280-bbfe-25188dce253a of volume c0ae0acd-fa55-45c0-bc27-2b468456cba6 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[666aecc9-d103-4d97-8957-9866f927c6b5]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:06 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-4f7729cb-5710-4a8c-ad6a-361bb04b2887" returned: 0 in 0.531s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:06 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6
Apr 24 14:50:06 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Lock "cinder-quobyte-4f7729cb-5710-4a8c-ad6a-361bb04b2887" released by "delete_volume" :: held 1.095s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Created reservations ['2bca5823-7ffd-4cd4-8860-96637a222cb7', 'eb19d4da-0d70-4b03-9afc-0377676f49d2', 'f7f36c99-2d87-4c80-b6d1-8db560d98112', '5136a0f2-eab3-42b6-9d31-946dfdb7e9b5'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:06 devstack sudo[89013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:50:06 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:06 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6" returned: 0 in 0.542s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:06 devstack sudo[89018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a 1G
Apr 24 14:50:06 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:06 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.468s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:50:06 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Deleted volume successfully.
Apr 24 14:50:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb9f57b-5505-4d40-bfc3-0f733bc23ec3 tempest-VolumesTransfersV357Test-127643786 None] Lock "cinder-4f7729cb-5710-4a8c-ad6a-361bb04b2887-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:07 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a 1G" returned: 0 in 0.647s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:07 devstack sudo[89024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a
Apr 24 14:50:07 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:08 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a" returned: 0 in 0.542s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:08 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a is being set with open permissions: ugo+rw
Apr 24 14:50:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:08 devstack sudo[89029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a
Apr 24 14:50:08 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:08 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a" returned: 0 in 0.507s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:08 devstack sudo[89032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.info
Apr 24 14:50:08 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:09 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.info" returned: 0 in 0.528s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:09 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.info is being set with open permissions: ugo+rw
Apr 24 14:50:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:09 devstack sudo[89035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.info
Apr 24 14:50:09 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:09 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.info" returned: 0 in 0.488s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.345s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:09 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b5cc222c-2892-41b6-8939-b1ce4768a678 tempest-VolumeDependencyTests-1905798628 None] Create snapshot completed successfully
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Flow 'volume_create_manager' (0359e69f-bc30-4030-88c2-d7687f7dade0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e514dbb-7a6e-49b8-acc5-47c4146bf400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e514dbb-7a6e-49b8-acc5-47c4146bf400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-850543532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd789fd7-12f7-4199-b4f3-76229ba0931b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12cb4d7573824bbca8b9b470fe306b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=654f7ca9-f4e2-4280-bbfe-25188dce253a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:11Z,use_quota=True,user_id='1ef9666a18c54a5fb6e031ec91765075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d417e751-54d5-494f-9f67-08e3f964ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d417e751-54d5-494f-9f67-08e3f964ab92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b0842c-bb60-4616-a03c-63e03912acdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b0842c-bb60-4616-a03c-63e03912acdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd789fd7-12f7-4199-b4f3-76229ba0931b', 'volume_name': 'volume-fd789fd7-12f7-4199-b4f3-76229ba0931b', 'volume_size': 1, 'snapshot_id': '654f7ca9-f4e2-4280-bbfe-25188dce253a'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a51bae-7d23-4246-ada3-981135015662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a51bae-7d23-4246-ada3-981135015662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0984e8-bc4c-4004-b050-92de784e717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:10 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Volume fd789fd7-12f7-4199-b4f3-76229ba0931b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd789fd7-12f7-4199-b4f3-76229ba0931b', 'volume_size': 1, 'snapshot_id': '654f7ca9-f4e2-4280-bbfe-25188dce253a'}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-quobyte-654f7ca9-f4e2-4280-bbfe-25188dce253a-fd789fd7-12f7-4199-b4f3-76229ba0931b" by "_create_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-654f7ca9-f4e2-4280-bbfe-25188dce253a-fd789fd7-12f7-4199-b4f3-76229ba0931b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Creating volume fd789fd7-12f7-4199-b4f3-76229ba0931b from snapshot 654f7ca9-f4e2-4280-bbfe-25188dce253a {{(pid=81510) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-quobyte-fd789fd7-12f7-4199-b4f3-76229ba0931b" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-fd789fd7-12f7-4199-b4f3-76229ba0931b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] snapshot: 654f7ca9-f4e2-4280-bbfe-25188dce253a, volume: fd789fd7-12f7-4199-b4f3-76229ba0931b,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f90313-bf15-4fda-9cff-28efce458128]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:11 devstack sudo[89038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a
Apr 24 14:50:11 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:11 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a" returned: 0 in 0.611s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba7f29b-614f-442a-9cd7-1762ba6d10c6]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:11 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6
Apr 24 14:50:11 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:12 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6" returned: 0 in 0.575s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:12 devstack sudo[89048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b
Apr 24 14:50:12 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Flow 'volume_create_manager' (0f2f40e8-9c4d-4467-93ad-27a625a7564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e174014-445b-420b-bde5-f038088c4a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e174014-445b-420b-bde5-f038088c4a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-113458828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36352b8-ca84-4c1e-a713-419816b377a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79350d364b9b4737a9c0d1474375f819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:12Z,use_quota=True,user_id='884b57f45bd04ed187fe2a0fa6a80525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca3745e-a922-458d-bad7-f40b30c6c1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca3745e-a922-458d-bad7-f40b30c6c1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e329b135-76b8-41ff-8a0a-874d01ee8e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e329b135-76b8-41ff-8a0a-874d01ee8e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36352b8-ca84-4c1e-a713-419816b377a3', 'volume_name': 'volume-e36352b8-ca84-4c1e-a713-419816b377a3', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4211b3-9ce0-4b5a-8b2b-0b43351a0942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4211b3-9ce0-4b5a-8b2b-0b43351a0942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e760084c-f142-49fa-8e45-28c5c9c930e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:12 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Volume e36352b8-ca84-4c1e-a713-419816b377a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36352b8-ca84-4c1e-a713-419816b377a3', 'volume_size': 1}
Apr 24 14:50:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:16 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b" returned: 0 in 4.451s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:16 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8f4ae8-c469-44f1-87dd-32857f1b2fdc]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:16 devstack sudo[89062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6
Apr 24 14:50:16 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:17 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6" returned: 0 in 0.624s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6, size 1024.00 MB, duration 4.45 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:50:17 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Converted 1024.00 MB image at 230.00 MB/s
Apr 24 14:50:17 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b is being set with open permissions: ugo+rw
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:17 devstack sudo[89067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b
Apr 24 14:50:17 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:17 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b" returned: 0 in 0.437s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-fd789fd7-12f7-4199-b4f3-76229ba0931b" released by "_copy_volume_from_snapshot" :: held 6.796s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-654f7ca9-f4e2-4280-bbfe-25188dce253a-fd789fd7-12f7-4199-b4f3-76229ba0931b" released by "_create_volume_from_snapshot" :: held 6.826s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.842s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.421s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-113458828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36352b8-ca84-4c1e-a713-419816b377a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79350d364b9b4737a9c0d1474375f819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:12Z,use_quota=True,user_id='884b57f45bd04ed187fe2a0fa6a80525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Creating volume e36352b8-ca84-4c1e-a713-419816b377a3 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:50:17 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:17 devstack sudo[89070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 1073741824
Apr 24 14:50:17 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0984e8-bc4c-4004-b050-92de784e717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd789fd7-12f7-4199-b4f3-76229ba0931b', 'volume_size': 1, 'snapshot_id': '654f7ca9-f4e2-4280-bbfe-25188dce253a'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a699e1e2-7fc2-434e-a0a0-de65392a13df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:17 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Volume volume-fd789fd7-12f7-4199-b4f3-76229ba0931b (fd789fd7-12f7-4199-b4f3-76229ba0931b): created successfully
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a699e1e2-7fc2-434e-a0a0-de65392a13df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:17 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Flow 'volume_create_manager' (0359e69f-bc30-4030-88c2-d7687f7dade0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:17 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4b8f7f69-0286-42ee-93e3-821eebd9b928 tempest-VolumeDependencyTests-1905798628 None] Created volume successfully.
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-654f7ca9-f4e2-4280-bbfe-25188dce253a-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-654f7ca9-f4e2-4280-bbfe-25188dce253a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-quobyte-c0ae0acd-fa55-45c0-bc27-2b468456cba6" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-c0ae0acd-fa55-45c0-bc27-2b468456cba6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-quobyte-654f7ca9-f4e2-4280-bbfe-25188dce253a" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-654f7ca9-f4e2-4280-bbfe-25188dce253a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Deleting offline snapshot 654f7ca9-f4e2-4280-bbfe-25188dce253a of volume c0ae0acd-fa55-45c0-bc27-2b468456cba6 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] snapshot_file for this snap is: volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb30dd05-42af-4869-b478-a9492dda932c]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:18 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 1073741824" returned: 0 in 0.626s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:18 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3
Apr 24 14:50:18 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:18 devstack sudo[89075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a
Apr 24 14:50:18 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:18 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3" returned: 0 in 0.461s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:18 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a" returned: 0 in 0.526s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e760084c-f142-49fa-8e45-28c5c9c930e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36352b8-ca84-4c1e-a713-419816b377a3', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807ce62b-635a-45b0-b889-e4f430b741c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab3e6ec-2569-4c71-92e9-4a6ffff9c2af]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:18 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Volume volume-e36352b8-ca84-4c1e-a713-419816b377a3 (e36352b8-ca84-4c1e-a713-419816b377a3): created successfully
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807ce62b-635a-45b0-b889-e4f430b741c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Flow 'volume_create_manager' (0f2f40e8-9c4d-4467-93ad-27a625a7564e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-bb7059f5-5679-408a-9d08-bfe61e4fe5a9 tempest-VolumesCloneTest-1656992690 None] Created volume successfully.
Apr 24 14:50:19 devstack sudo[89083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6
Apr 24 14:50:19 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:19 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6" returned: 0 in 0.519s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:19 devstack sudo[89088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a
Apr 24 14:50:19 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:20 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a" returned: 0 in 0.557s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:20 devstack sudo[89093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a
Apr 24 14:50:20 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Flow 'volume_create_manager' (135437f8-5b51-4dbb-8e37-107ad9a56ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea1ad3-8d8d-4c07-af8a-3c08b6f92fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea1ad3-8d8d-4c07-af8a-3c08b6f92fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-131243095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9856db0-4283-4bc3-8f66-3ba257c950c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79350d364b9b4737a9c0d1474375f819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=e36352b8-ca84-4c1e-a713-419816b377a3,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:20Z,use_quota=True,user_id='884b57f45bd04ed187fe2a0fa6a80525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa1cf0d-6ae6-4d6a-abdb-9066b53b3795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa1cf0d-6ae6-4d6a-abdb-9066b53b3795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdd2a8c-4b52-4063-8c85-4e25f4ba0d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdd2a8c-4b52-4063-8c85-4e25f4ba0d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b9856db0-4283-4bc3-8f66-3ba257c950c3', 'volume_name': 'volume-b9856db0-4283-4bc3-8f66-3ba257c950c3', 'volume_size': 2, 'source_volid': 'e36352b8-ca84-4c1e-a713-419816b377a3', 'source_volstatus': 'available'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3278cc2-92d3-44c4-9615-1f5343b56327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3278cc2-92d3-44c4-9615-1f5343b56327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0ccfa8-25fb-4868-acb4-f430bc79459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:20 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Volume b9856db0-4283-4bc3-8f66-3ba257c950c3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b9856db0-4283-4bc3-8f66-3ba257c950c3', 'volume_size': 2, 'source_volid': 'e36352b8-ca84-4c1e-a713-419816b377a3', 'source_volstatus': 'available'}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:20 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Cloning volume e36352b8-ca84-4c1e-a713-419816b377a3 to volume b9856db0-4283-4bc3-8f66-3ba257c950c3
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Creating offline snapshot 9e1ccff9-ce94-4651-96ea-73477c491731 of volume e36352b8-ca84-4c1e-a713-419816b377a3 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bda81d0-3227-43a4-953e-5552f5067b2b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:20 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3
Apr 24 14:50:20 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:20 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6.654f7ca9-f4e2-4280-bbfe-25188dce253a" returned: 0 in 0.445s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-654f7ca9-f4e2-4280-bbfe-25188dce253a" released by "_delete_snapshot" :: held 2.146s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-c0ae0acd-fa55-45c0-bc27-2b468456cba6" released by "delete_snapshot" :: held 2.170s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Created reservations ['61d27ccd-d54c-40ee-a3bc-5d80a00d7067', 'a275548a-3c50-4618-8f86-61a9230511d8', 'ddf2d243-025c-4a77-9a1e-726dac5eec99', 'c12378d4-b3e1-420f-8bc6-e1dc1353baf9'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:50:20 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Delete snapshot completed successfully.
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-80488ff8-0519-4b4a-b334-c6b8a311983e tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-654f7ca9-f4e2-4280-bbfe-25188dce253a-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:20 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3" returned: 0 in 0.552s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:20 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731 1G
Apr 24 14:50:20 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:21 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731 1G" returned: 0 in 0.590s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e36352b8-ca84-4c1e-a713-419816b377a3 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:21 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e36352b8-ca84-4c1e-a713-419816b377a3 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731
Apr 24 14:50:21 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-c0ae0acd-fa55-45c0-bc27-2b468456cba6-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-c0ae0acd-fa55-45c0-bc27-2b468456cba6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-quobyte-c0ae0acd-fa55-45c0-bc27-2b468456cba6" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-c0ae0acd-fa55-45c0-bc27-2b468456cba6" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:21 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dbea4a-e4d3-483a-a793-6bc2e8c522f9]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:21 devstack sudo[89108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6
Apr 24 14:50:21 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:21 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e36352b8-ca84-4c1e-a713-419816b377a3 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731" returned: 0 in 0.526s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:21 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731 is being set with open permissions: ugo+rw
Apr 24 14:50:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:21 devstack sudo[89113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731
Apr 24 14:50:21 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:22 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6" returned: 0 in 0.530s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:22 devstack sudo[89118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6
Apr 24 14:50:22 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:22 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731" returned: 0 in 0.437s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:22 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.info
Apr 24 14:50:22 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:22 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c0ae0acd-fa55-45c0-bc27-2b468456cba6" returned: 0 in 0.462s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-c0ae0acd-fa55-45c0-bc27-2b468456cba6" released by "delete_volume" :: held 1.046s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Created reservations ['1595348e-2e5e-4fcf-ab25-93330b55a14f', '36e768ae-a2b1-4a58-81dd-1ab1e9e39e97', '36e110da-f2b6-440a-9e98-9b1fd5106dea', '133d5af8-19a1-48f8-bfab-59647f6611fb'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:22 devstack sudo[89125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:50:22 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:22 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.info" returned: 0 in 0.466s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:22 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.info is being set with open permissions: ugo+rw
Apr 24 14:50:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:22 devstack sudo[89128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.info
Apr 24 14:50:22 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:23 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.460s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:50:23 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Deleted volume successfully.
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b05a30ca-a56b-4146-b3d4-e6bfd77b2818 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-c0ae0acd-fa55-45c0-bc27-2b468456cba6-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:23 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.info" returned: 0 in 0.476s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "cinder-quobyte-b9856db0-4283-4bc3-8f66-3ba257c950c3" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-quobyte-b9856db0-4283-4bc3-8f66-3ba257c950c3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] snapshot: 9e1ccff9-ce94-4651-96ea-73477c491731, volume: b9856db0-4283-4bc3-8f66-3ba257c950c3,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e81324-2742-462e-a3a4-4d1c30c71d96]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:23 devstack sudo[89132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731
Apr 24 14:50:23 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:50:24 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Flow 'volume_create_manager' (2f058337-cee6-4785-bbd9-e17c5adb50b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb280dc2-f6c5-49db-8527-1910676ae8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731" returned: 0 in 0.596s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e36352b8-ca84-4c1e-a713-419816b377a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[048b6cd9-ecc8-4991-8011-fa4672a477f5]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb280dc2-f6c5-49db-8527-1910676ae8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-947777413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3c39c7-9741-480d-ad50-3b386f8850be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12cb4d7573824bbca8b9b470fe306b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:24Z,use_quota=True,user_id='1ef9666a18c54a5fb6e031ec91765075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255d408a-e318-4364-9622-58e8a777e143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255d408a-e318-4364-9622-58e8a777e143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47149c1-063b-4ead-b7de-b48da99ec9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47149c1-063b-4ead-b7de-b48da99ec9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf3c39c7-9741-480d-ad50-3b386f8850be', 'volume_name': 'volume-bf3c39c7-9741-480d-ad50-3b386f8850be', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5598de9-29ec-4649-8ed2-c33c3e882475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5598de9-29ec-4649-8ed2-c33c3e882475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0349a069-56b7-41ac-a2dc-bb33a8027a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:24 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Volume bf3c39c7-9741-480d-ad50-3b386f8850be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf3c39c7-9741-480d-ad50-3b386f8850be', 'volume_size': 1}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:24 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3
Apr 24 14:50:24 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:24 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3" returned: 0 in 0.505s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3 not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:50:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:24 devstack sudo[89176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3
Apr 24 14:50:24 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:29 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3" returned: 0 in 4.459s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:29 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe5741a-ca6c-49f5-b18a-4554d26fe6e1]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:29 devstack sudo[89188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3
Apr 24 14:50:29 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:29 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3" returned: 0 in 0.635s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:29 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3 {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:50:29 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Converted 1024.00 MB image at 229.60 MB/s
Apr 24 14:50:29 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3 is being set with open permissions: ugo+rw
Apr 24 14:50:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:29 devstack sudo[89193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3
Apr 24 14:50:29 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:30 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3" returned: 0 in 0.432s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-quobyte-b9856db0-4283-4bc3-8f66-3ba257c950c3" released by "_copy_volume_from_snapshot" :: held 6.733s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "cinder-quobyte-9e1ccff9-ce94-4651-96ea-73477c491731" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-quobyte-9e1ccff9-ce94-4651-96ea-73477c491731" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Deleting offline snapshot 9e1ccff9-ce94-4651-96ea-73477c491731 of volume e36352b8-ca84-4c1e-a713-419816b377a3 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] snapshot_file for this snap is: volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8f8374-ff22-48a1-8e1b-b1893092c8f2]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:30 devstack sudo[89196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731
Apr 24 14:50:30 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:30 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731" returned: 0 in 0.508s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e36352b8-ca84-4c1e-a713-419816b377a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c6440c-5eed-475f-9915-9441bb10059f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:30 devstack sudo[89201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3
Apr 24 14:50:30 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:31 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3" returned: 0 in 0.513s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:31 devstack sudo[89206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731
Apr 24 14:50:31 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:31 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731" returned: 0 in 0.532s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:31 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731
Apr 24 14:50:31 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:32 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3.9e1ccff9-ce94-4651-96ea-73477c491731" returned: 0 in 0.423s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-quobyte-9e1ccff9-ce94-4651-96ea-73477c491731" released by "_delete_snapshot" :: held 2.067s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.022s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.148s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-947777413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3c39c7-9741-480d-ad50-3b386f8850be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12cb4d7573824bbca8b9b470fe306b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:24Z,use_quota=True,user_id='1ef9666a18c54a5fb6e031ec91765075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Creating volume bf3c39c7-9741-480d-ad50-3b386f8850be {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:50:32 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:32 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be 1073741824
Apr 24 14:50:32 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0ccfa8-25fb-4868-acb4-f430bc79459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9856db0-4283-4bc3-8f66-3ba257c950c3', 'volume_size': 2, 'source_volid': 'e36352b8-ca84-4c1e-a713-419816b377a3', 'source_volstatus': 'available'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cb8521-835a-48bd-acc1-d6a05b84c44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:32 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Volume volume-b9856db0-4283-4bc3-8f66-3ba257c950c3 (b9856db0-4283-4bc3-8f66-3ba257c950c3): created successfully
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cb8521-835a-48bd-acc1-d6a05b84c44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Flow 'volume_create_manager' (135437f8-5b51-4dbb-8e37-107ad9a56ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:32 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-cb82b175-9655-426d-911a-31d2e20a0ec2 tempest-VolumesCloneTest-1656992690 None] Created volume successfully.
Apr 24 14:50:32 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be 1073741824" returned: 0 in 0.629s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:32 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be
Apr 24 14:50:32 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "cinder-b9856db0-4283-4bc3-8f66-3ba257c950c3-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-b9856db0-4283-4bc3-8f66-3ba257c950c3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "cinder-quobyte-b9856db0-4283-4bc3-8f66-3ba257c950c3" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-quobyte-b9856db0-4283-4bc3-8f66-3ba257c950c3" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2372591d-a9fe-4711-8db6-0d6614e6659a]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:33 devstack sudo[89222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3
Apr 24 14:50:33 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:33 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be" returned: 0 in 0.487s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0349a069-56b7-41ac-a2dc-bb33a8027a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf3c39c7-9741-480d-ad50-3b386f8850be', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bdbb15-6648-4fb1-bfe6-e41462064eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:33 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Volume volume-bf3c39c7-9741-480d-ad50-3b386f8850be (bf3c39c7-9741-480d-ad50-3b386f8850be): created successfully
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bdbb15-6648-4fb1-bfe6-e41462064eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Flow 'volume_create_manager' (2f058337-cee6-4785-bbd9-e17c5adb50b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:33 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-eb842f5c-d789-4bc6-a161-70dc55ff91f5 tempest-VolumeDependencyTests-1905798628 None] Created volume successfully.
Apr 24 14:50:33 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3" returned: 0 in 0.505s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:33 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3
Apr 24 14:50:33 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Flow 'volume_create_manager' (8c729c31-a682-4483-b8ef-0f32fde317d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab33202-5599-478a-acca-9c2f53bf95a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab33202-5599-478a-acca-9c2f53bf95a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-231121083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcbbff4-dc5d-410b-8907-a468ee462f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12cb4d7573824bbca8b9b470fe306b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=bf3c39c7-9741-480d-ad50-3b386f8850be,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:34Z,use_quota=True,user_id='1ef9666a18c54a5fb6e031ec91765075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9b9f41-3bc8-4907-aa6f-f4c263d3aca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9b9f41-3bc8-4907-aa6f-f4c263d3aca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2e9499-04f2-4565-b29c-a8844b10ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2e9499-04f2-4565-b29c-a8844b10ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'efcbbff4-dc5d-410b-8907-a468ee462f3e', 'volume_name': 'volume-efcbbff4-dc5d-410b-8907-a468ee462f3e', 'volume_size': 1, 'source_volid': 'bf3c39c7-9741-480d-ad50-3b386f8850be', 'source_volstatus': 'available'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152628f8-05f6-4b5d-86c5-d89699d9f03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152628f8-05f6-4b5d-86c5-d89699d9f03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26262d7b-8224-4aaa-bb72-e400b111c751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:34 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Volume efcbbff4-dc5d-410b-8907-a468ee462f3e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-efcbbff4-dc5d-410b-8907-a468ee462f3e', 'volume_size': 1, 'source_volid': 'bf3c39c7-9741-480d-ad50-3b386f8850be', 'source_volstatus': 'available'}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:34 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Cloning volume bf3c39c7-9741-480d-ad50-3b386f8850be to volume efcbbff4-dc5d-410b-8907-a468ee462f3e
Apr 24 14:50:34 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b9856db0-4283-4bc3-8f66-3ba257c950c3" returned: 0 in 0.450s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-quobyte-b9856db0-4283-4bc3-8f66-3ba257c950c3" released by "delete_volume" :: held 1.002s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Creating offline snapshot 37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 of volume bf3c39c7-9741-480d-ad50-3b386f8850be {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4eedc4-b215-4581-a330-4542f5cf33bb]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Created reservations ['2332a009-9e26-47d0-af68-b2299bc7c8dd', '9620d285-f717-47b7-9af4-7f4ff71d79b4', 'e87e4439-12a4-42cc-a8d2-993348ad760d', '56866462-7e3b-4284-9d05-8126c20204b4'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:34 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be
Apr 24 14:50:34 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:34 devstack sudo[89232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:50:34 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:34 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.441s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:50:34 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Deleted volume successfully.
Apr 24 14:50:34 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be" returned: 0 in 0.543s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-20c42b8a-ea62-4297-b0fe-1e9f1a9052f9 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-b9856db0-4283-4bc3-8f66-3ba257c950c3-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:34 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 1G
Apr 24 14:50:34 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:35 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 1G" returned: 0 in 0.614s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3c39c7-9741-480d-ad50-3b386f8850be -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "cinder-e36352b8-ca84-4c1e-a713-419816b377a3-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:35 devstack sudo[89244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3c39c7-9741-480d-ad50-3b386f8850be -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9
Apr 24 14:50:35 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-e36352b8-ca84-4c1e-a713-419816b377a3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "cinder-quobyte-e36352b8-ca84-4c1e-a713-419816b377a3" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:35 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-quobyte-e36352b8-ca84-4c1e-a713-419816b377a3" acquired by "delete_volume" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:35 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d898102-d7fa-451f-9e2e-696f1381f831]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:35 devstack sudo[89246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3
Apr 24 14:50:35 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:35 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf3c39c7-9741-480d-ad50-3b386f8850be -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9" returned: 0 in 0.484s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:35 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 is being set with open permissions: ugo+rw
Apr 24 14:50:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:35 devstack sudo[89251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9
Apr 24 14:50:35 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:36 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3" returned: 0 in 0.545s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:36 devstack sudo[89256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3
Apr 24 14:50:36 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:36 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9" returned: 0 in 0.445s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:36 devstack sudo[89259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.info
Apr 24 14:50:36 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:36 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-e36352b8-ca84-4c1e-a713-419816b377a3" returned: 0 in 0.439s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-quobyte-e36352b8-ca84-4c1e-a713-419816b377a3" released by "delete_volume" :: held 1.042s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Created reservations ['c0200ab7-0c84-4096-906a-e73de8f99d3c', '5ffecafc-7db0-4e84-970d-ba75403fb991', '2c32bdfd-966b-4c58-9ea3-239c5763cb38', '0d67e735-45fb-4364-af2f-5d5e3af21913'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:36 devstack sudo[89262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:50:36 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:36 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.info" returned: 0 in 0.498s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:36 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.info is being set with open permissions: ugo+rw
Apr 24 14:50:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:36 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.info
Apr 24 14:50:36 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:37 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.458s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:50:37 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Deleted volume successfully.
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ea0fb893-7827-4e0e-916a-48f182e25dd7 tempest-VolumesCloneTest-1656992690 None] Lock "cinder-e36352b8-ca84-4c1e-a713-419816b377a3-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:37 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.info" returned: 0 in 0.454s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-quobyte-efcbbff4-dc5d-410b-8907-a468ee462f3e" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-efcbbff4-dc5d-410b-8907-a468ee462f3e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] snapshot: 37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9, volume: efcbbff4-dc5d-410b-8907-a468ee462f3e,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdd26b2-c6d9-4d4e-9869-14c83c20e6e7]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:37 devstack sudo[89269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9
Apr 24 14:50:37 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:37 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9" returned: 0 in 0.545s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf3c39c7-9741-480d-ad50-3b386f8850be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d42daa-1e83-4024-8aec-7876690bf876]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:38 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be
Apr 24 14:50:38 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:38 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be" returned: 0 in 0.592s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:38 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:50:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:38 devstack sudo[89279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e
Apr 24 14:50:38 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:40 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:50:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Flow 'volume_create_manager' (0cfd3f90-b998-4222-ad81-22d98c7a26dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457a0fbb-e173-41bf-bf0e-4375a9e3cc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:40 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457a0fbb-e173-41bf-bf0e-4375a9e3cc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1453940139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8bc6df-77c9-4721-9639-fc36607302d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76eca7d6a1b9487fae776f8f5d915d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:41Z,use_quota=True,user_id='8df1fa1161ec4218b21d3abd357aed8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0a8eea-f35f-4c86-b984-8c62f7ba1eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0a8eea-f35f-4c86-b984-8c62f7ba1eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0164e7be-99ac-410f-9002-c8fe604893f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0164e7be-99ac-410f-9002-c8fe604893f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef8bc6df-77c9-4721-9639-fc36607302d3', 'volume_name': 'volume-ef8bc6df-77c9-4721-9639-fc36607302d3', 'volume_size': 2}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb68b238-d999-4c97-8e6e-2c3474e3e561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb68b238-d999-4c97-8e6e-2c3474e3e561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:41 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f56379-333b-4b25-9c1d-4d1bc461aaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:41 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Volume ef8bc6df-77c9-4721-9639-fc36607302d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef8bc6df-77c9-4721-9639-fc36607302d3', 'volume_size': 2}
Apr 24 14:50:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:43 devstack sudo[89296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:50:43 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:43 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e" returned: 0 in 4.880s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0026b9b4-3d96-4bdc-81d9-3cd79513fda2]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:43 devstack sudo[89298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be
Apr 24 14:50:43 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:43 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.412s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:43 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:50:44 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be" returned: 0 in 0.651s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:44 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:50:44 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Converted 1024.00 MB image at 209.76 MB/s
Apr 24 14:50:44 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e is being set with open permissions: ugo+rw
Apr 24 14:50:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:44 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e
Apr 24 14:50:44 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:44 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e" returned: 0 in 0.420s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-efcbbff4-dc5d-410b-8907-a468ee462f3e" released by "_copy_volume_from_snapshot" :: held 7.166s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-quobyte-37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:44 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Deleting offline snapshot 37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 of volume bf3c39c7-9741-480d-ad50-3b386f8850be {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:50:44 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] snapshot_file for this snap is: volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:50:44 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a5e3ce-1ab7-4e18-8869-0a554da0fdcf]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:44 devstack sudo[89307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9
Apr 24 14:50:44 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:45 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9" returned: 0 in 0.510s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf3c39c7-9741-480d-ad50-3b386f8850be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:50:45 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e5ffa-755f-4c1c-a879-a7df2947d962]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:45 devstack sudo[89312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be
Apr 24 14:50:45 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:45 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be" returned: 0 in 0.520s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:45 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9
Apr 24 14:50:45 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:46 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9" returned: 0 in 0.516s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:46 devstack sudo[89322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9
Apr 24 14:50:46 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:46 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be.37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9" returned: 0 in 0.444s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-37fe6aec-c5ee-4c3c-83a9-42b0621ec1b9" released by "_delete_snapshot" :: held 2.079s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.501s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.585s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1453940139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8bc6df-77c9-4721-9639-fc36607302d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76eca7d6a1b9487fae776f8f5d915d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:41Z,use_quota=True,user_id='8df1fa1161ec4218b21d3abd357aed8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Creating volume ef8bc6df-77c9-4721-9639-fc36607302d3 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:50:46 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3 2147483648 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:46 devstack sudo[89325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3 2147483648
Apr 24 14:50:46 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26262d7b-8224-4aaa-bb72-e400b111c751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efcbbff4-dc5d-410b-8907-a468ee462f3e', 'volume_size': 1, 'source_volid': 'bf3c39c7-9741-480d-ad50-3b386f8850be', 'source_volstatus': 'available'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3265fb8-eb98-4191-b34f-1395b2a7bc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:46 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Volume volume-efcbbff4-dc5d-410b-8907-a468ee462f3e (efcbbff4-dc5d-410b-8907-a468ee462f3e): created successfully
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3265fb8-eb98-4191-b34f-1395b2a7bc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Flow 'volume_create_manager' (8c729c31-a682-4483-b8ef-0f32fde317d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:46 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c9ab52fd-1a28-4042-b20e-60743a9fcae1 tempest-VolumeDependencyTests-1905798628 None] Created volume successfully.
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-bf3c39c7-9741-480d-ad50-3b386f8850be-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-bf3c39c7-9741-480d-ad50-3b386f8850be-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-quobyte-bf3c39c7-9741-480d-ad50-3b386f8850be" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-bf3c39c7-9741-480d-ad50-3b386f8850be" acquired by "delete_volume" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2748fecb-b8f2-4c4a-92d4-f60be147d4fd]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:47 devstack sudo[89330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be
Apr 24 14:50:47 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:47 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3 2147483648" returned: 0 in 0.778s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:47 devstack sudo[89333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3
Apr 24 14:50:47 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:47 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be" returned: 0 in 0.550s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:47 devstack sudo[89338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be
Apr 24 14:50:47 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:47 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3" returned: 0 in 0.483s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f56379-333b-4b25-9c1d-4d1bc461aaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef8bc6df-77c9-4721-9639-fc36607302d3', 'volume_size': 2}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8daa24-5a2b-400b-a41b-bdc301985f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:47 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Volume volume-ef8bc6df-77c9-4721-9639-fc36607302d3 (ef8bc6df-77c9-4721-9639-fc36607302d3): created successfully
Apr 24 14:50:47 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8daa24-5a2b-400b-a41b-bdc301985f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Flow 'volume_create_manager' (0cfd3f90-b998-4222-ad81-22d98c7a26dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:48 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-03019f60-c73b-4233-bc2d-7f94541ff82e tempest-VolumesCloneNegativeTest-156220343 None] Created volume successfully.
Apr 24 14:50:48 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bf3c39c7-9741-480d-ad50-3b386f8850be" returned: 0 in 0.477s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-bf3c39c7-9741-480d-ad50-3b386f8850be" released by "delete_volume" :: held 1.097s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Created reservations ['40550ee4-b758-4d9d-bfd6-3002b32a5510', '60a66899-1eff-4c12-b1ac-3345332c33ab', '29f9c4bc-a12e-4d29-ad0f-c0842c09c4db', '813dcc0a-de3d-4683-8eca-f99ceb3ee0c6'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:48 devstack sudo[89342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:50:48 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Acquiring lock "cinder-ef8bc6df-77c9-4721-9639-fc36607302d3-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Lock "cinder-ef8bc6df-77c9-4721-9639-fc36607302d3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Acquiring lock "cinder-quobyte-ef8bc6df-77c9-4721-9639-fc36607302d3" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Lock "cinder-quobyte-ef8bc6df-77c9-4721-9639-fc36607302d3" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae12572-efd3-488f-a425-94f500fd8129]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:48 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3
Apr 24 14:50:48 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:48 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.487s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:50:48 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Deleted volume successfully.
Apr 24 14:50:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e167f328-6990-43c4-a74c-16cda73cb4b6 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-bf3c39c7-9741-480d-ad50-3b386f8850be-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:49 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3" returned: 0 in 0.528s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:49 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3
Apr 24 14:50:49 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-efcbbff4-dc5d-410b-8907-a468ee462f3e-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-efcbbff4-dc5d-410b-8907-a468ee462f3e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-quobyte-efcbbff4-dc5d-410b-8907-a468ee462f3e" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-efcbbff4-dc5d-410b-8907-a468ee462f3e" acquired by "delete_volume" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1051187-5080-41df-bc0a-b35ffbf40fb5]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:49 devstack sudo[89352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e
Apr 24 14:50:49 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:49 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-ef8bc6df-77c9-4721-9639-fc36607302d3" returned: 0 in 0.476s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Lock "cinder-quobyte-ef8bc6df-77c9-4721-9639-fc36607302d3" released by "delete_volume" :: held 1.052s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Created reservations ['ac052b99-283a-4818-bbe6-ec725c92136a', 'dbdf516f-9837-47f4-af13-ad5535b61b7b', 'd5c2e0ed-fe7b-49f0-81c3-4b749b2a22f3', 'a7e9bdce-2c27-4286-9222-b2925f961d01'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:49 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:50:49 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:49 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e" returned: 0 in 0.536s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:50 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e
Apr 24 14:50:50 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:50 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.437s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:50:50 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Deleted volume successfully.
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-450f6f61-5187-45e1-b24b-12ea17faa163 tempest-VolumesCloneNegativeTest-156220343 None] Lock "cinder-ef8bc6df-77c9-4721-9639-fc36607302d3-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:50 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-efcbbff4-dc5d-410b-8907-a468ee462f3e" returned: 0 in 0.473s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-efcbbff4-dc5d-410b-8907-a468ee462f3e" released by "delete_volume" :: held 1.047s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Created reservations ['c5ec8ba8-3730-4239-a337-f3ede2b5cd3d', 'fb161e07-d902-41c0-86f1-66a125ad7245', 'ecd488cc-5ca1-4f12-8745-8b66fe64b369', '9b709b84-db06-48e7-83ad-faf05e2d63b5'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:50 devstack sudo[89366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:50:50 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:51 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.450s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:51 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:50:51 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Deleted volume successfully.
Apr 24 14:50:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a0a323c-9a3d-43bc-bf82-eef0e96b8213 tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-efcbbff4-dc5d-410b-8907-a468ee462f3e-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-fd789fd7-12f7-4199-b4f3-76229ba0931b-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-fd789fd7-12f7-4199-b4f3-76229ba0931b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "cinder-quobyte-fd789fd7-12f7-4199-b4f3-76229ba0931b" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:50:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-fd789fd7-12f7-4199-b4f3-76229ba0931b" acquired by "delete_volume" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:50:51 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cde1102-f399-4749-9b77-d6dbea3f2577]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:50:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:51 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b
Apr 24 14:50:51 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:52 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b" returned: 0 in 0.598s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:52 devstack sudo[89382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b
Apr 24 14:50:52 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:52 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-fd789fd7-12f7-4199-b4f3-76229ba0931b" returned: 0 in 0.472s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-quobyte-fd789fd7-12f7-4199-b4f3-76229ba0931b" released by "delete_volume" :: held 1.109s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:INSERT=29,cinder:SELECT=85,cinder:UPDATE=111,cinder:DELETE=10 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=103,cinder:INSERT=41,cinder:UPDATE=131,cinder:DELETE=12 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Created reservations ['1fb7c284-25d6-4ce8-8092-1d996167dd2e', '0e18994f-493e-4d6b-b617-acc51e2967c8', '9997de3e-4aae-4f36-ad99-a034357d8a44', 'd376c89d-ca0b-4ecd-b6b3-148b011c6019'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:52 devstack sudo[89385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:50:52 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Flow 'volume_create_manager' (710a499c-88ae-4653-9f72-5971ad4b92e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91313e2-af68-48c9-b41d-b45ae98cafc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91313e2-af68-48c9-b41d-b45ae98cafc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-402754207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29449208-c471-4964-b03b-9483814fc89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2bb6b0816049fd87e8e78ba60778b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:53Z,use_quota=True,user_id='974bbd593a904aae9c78cdc54b5ecc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e247b8-2911-40ae-b6ed-3b1617a69fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e247b8-2911-40ae-b6ed-3b1617a69fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970642bd-41a2-4cf2-9604-24d50aafc3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970642bd-41a2-4cf2-9604-24d50aafc3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29449208-c471-4964-b03b-9483814fc89a', 'volume_name': 'volume-29449208-c471-4964-b03b-9483814fc89a', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2e485f-74ef-433e-bfd2-ad26e120cb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2e485f-74ef-433e-bfd2-ad26e120cb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261257fe-41d5-43f7-8cfe-a55837aa640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:53 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Volume 29449208-c471-4964-b03b-9483814fc89a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29449208-c471-4964-b03b-9483814fc89a', 'volume_size': 1}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-402754207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29449208-c471-4964-b03b-9483814fc89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2bb6b0816049fd87e8e78ba60778b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:50:53Z,use_quota=True,user_id='974bbd593a904aae9c78cdc54b5ecc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Creating volume 29449208-c471-4964-b03b-9483814fc89a {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:50:53 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:53 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a 1073741824
Apr 24 14:50:53 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:53 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.462s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:50:53 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Deleted volume successfully.
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-cdb8cbaa-cf3c-48bb-8128-8926518df1dd tempest-VolumeDependencyTests-1905798628 None] Lock "cinder-fd789fd7-12f7-4199-b4f3-76229ba0931b-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:50:53 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a 1073741824" returned: 0 in 0.591s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:50:53 devstack sudo[89393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a
Apr 24 14:50:53 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:50:54 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root
Apr 24 14:50:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a" returned: 0 in 0.492s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:50:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:50:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:50:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261257fe-41d5-43f7-8cfe-a55837aa640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29449208-c471-4964-b03b-9483814fc89a', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa791d68-5041-491e-905f-a74bac7466ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:50:54 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Volume volume-29449208-c471-4964-b03b-9483814fc89a (29449208-c471-4964-b03b-9483814fc89a): created successfully
Apr 24 14:50:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa791d68-5041-491e-905f-a74bac7466ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:50:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Flow 'volume_create_manager' (710a499c-88ae-4653-9f72-5971ad4b92e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:50:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-44ffa3eb-0d93-4b71-b23a-00c5a866b2c1 tempest-VolumesNegativeTest-192208633 None] Created volume successfully.
Apr 24 14:51:04 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=1 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:51:04 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Flow 'volume_create_manager' (967b9b51-3443-4c8d-ba86-9a0dc74cfb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f960719-5f8d-415b-bb26-4b363325ab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f960719-5f8d-415b-bb26-4b363325ab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-630808909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31dedb3-f631-4398-b213-a06985cd82c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5f62ae927644328ee8438e5a3ee59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:18Z,use_quota=True,user_id='a832f4553def467ca00c3a7c5baf08a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e528dd28-e5fe-4b9e-ba0c-322c413a8d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e528dd28-e5fe-4b9e-ba0c-322c413a8d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51d251c-cefc-47dc-b856-4e7bcbc877e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51d251c-cefc-47dc-b856-4e7bcbc877e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31dedb3-f631-4398-b213-a06985cd82c8', 'volume_name': 'volume-b31dedb3-f631-4398-b213-a06985cd82c8', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455628f8-a933-451c-8a0c-b14292c2ec98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455628f8-a933-451c-8a0c-b14292c2ec98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf7d5aa-57b9-4b8e-9dea-248776654093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:18 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Volume b31dedb3-f631-4398-b213-a06985cd82c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31dedb3-f631-4398-b213-a06985cd82c8', 'volume_size': 1}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-630808909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31dedb3-f631-4398-b213-a06985cd82c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5f62ae927644328ee8438e5a3ee59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:18Z,use_quota=True,user_id='a832f4553def467ca00c3a7c5baf08a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Creating volume b31dedb3-f631-4398-b213-a06985cd82c8 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:51:18 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:18 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 1073741824
Apr 24 14:51:18 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:18 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 1073741824" returned: 0 in 0.610s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:18 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8
Apr 24 14:51:18 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:19 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8" returned: 0 in 0.454s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:51:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf7d5aa-57b9-4b8e-9dea-248776654093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31dedb3-f631-4398-b213-a06985cd82c8', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ce1156-769f-41b5-9b28-5f78f66aa229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:19 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Volume volume-b31dedb3-f631-4398-b213-a06985cd82c8 (b31dedb3-f631-4398-b213-a06985cd82c8): created successfully
Apr 24 14:51:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ce1156-769f-41b5-9b28-5f78f66aa229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Flow 'volume_create_manager' (967b9b51-3443-4c8d-ba86-9a0dc74cfb0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-faa866ca-a820-43eb-b721-b7ad7f7dc072 tempest-SnapshotDependencyTests-313609250 None] Created volume successfully.
Apr 24 14:51:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] Creating offline snapshot 4a3188b1-c6dd-48ad-8e85-b08818d005ad of volume b31dedb3-f631-4398-b213-a06985cd82c8 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:51:20 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[77925889-e858-43d1-86ef-cc1fe002e08c]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:20 devstack sudo[89501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8
Apr 24 14:51:20 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:21 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8" returned: 0 in 0.518s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:21 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad 1G
Apr 24 14:51:21 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:21 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad 1G" returned: 0 in 0.610s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b31dedb3-f631-4398-b213-a06985cd82c8 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:21 devstack sudo[89512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b31dedb3-f631-4398-b213-a06985cd82c8 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad
Apr 24 14:51:21 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:22 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b31dedb3-f631-4398-b213-a06985cd82c8 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad" returned: 0 in 0.569s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:22 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad is being set with open permissions: ugo+rw
Apr 24 14:51:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:22 devstack sudo[89518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad
Apr 24 14:51:22 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:22 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad" returned: 0 in 0.513s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:22 devstack sudo[89522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.info
Apr 24 14:51:22 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:23 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.info" returned: 0 in 0.457s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:23 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.info is being set with open permissions: ugo+rw
Apr 24 14:51:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:23 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.info
Apr 24 14:51:23 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:23 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.info" returned: 0 in 0.448s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.211s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:23 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-cd7d88f4-08d8-4daf-a12e-ef5066023418 tempest-SnapshotDependencyTests-313609250 None] Create snapshot completed successfully
Apr 24 14:51:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Acquiring lock "cinder-29449208-c471-4964-b03b-9483814fc89a-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Lock "cinder-29449208-c471-4964-b03b-9483814fc89a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Acquiring lock "cinder-quobyte-29449208-c471-4964-b03b-9483814fc89a" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Lock "cinder-quobyte-29449208-c471-4964-b03b-9483814fc89a" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:24 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[111e4997-1e8d-4800-980c-3af6c59558a4]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:25 devstack sudo[89562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a
Apr 24 14:51:25 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Flow 'volume_create_manager' (33240418-b37b-42cc-b7fb-bf6624e6d9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af6f066-3ce9-4e8c-8b27-e8eb5966cd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af6f066-3ce9-4e8c-8b27-e8eb5966cd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19ed93b-0777-4e4b-9333-aad2c22035f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5f62ae927644328ee8438e5a3ee59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4a3188b1-c6dd-48ad-8e85-b08818d005ad,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:25Z,use_quota=True,user_id='a832f4553def467ca00c3a7c5baf08a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbb1585-fe64-4771-809f-850bb59bd4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbb1585-fe64-4771-809f-850bb59bd4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd867787-e7ce-46d9-a5a2-b94325cfd726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd867787-e7ce-46d9-a5a2-b94325cfd726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b19ed93b-0777-4e4b-9333-aad2c22035f2', 'volume_name': 'volume-b19ed93b-0777-4e4b-9333-aad2c22035f2', 'volume_size': 1, 'snapshot_id': '4a3188b1-c6dd-48ad-8e85-b08818d005ad'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ff48b1-b775-4aa7-8d7c-eed26d1e7883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ff48b1-b775-4aa7-8d7c-eed26d1e7883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180ef98c-6b61-47cf-9cca-9d9b1236bcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:25 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Volume b19ed93b-0777-4e4b-9333-aad2c22035f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b19ed93b-0777-4e4b-9333-aad2c22035f2', 'volume_size': 1, 'snapshot_id': '4a3188b1-c6dd-48ad-8e85-b08818d005ad'}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "cinder-quobyte-4a3188b1-c6dd-48ad-8e85-b08818d005ad-b19ed93b-0777-4e4b-9333-aad2c22035f2" by "_create_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-4a3188b1-c6dd-48ad-8e85-b08818d005ad-b19ed93b-0777-4e4b-9333-aad2c22035f2" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Creating volume b19ed93b-0777-4e4b-9333-aad2c22035f2 from snapshot 4a3188b1-c6dd-48ad-8e85-b08818d005ad {{(pid=81510) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "cinder-quobyte-b19ed93b-0777-4e4b-9333-aad2c22035f2" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-b19ed93b-0777-4e4b-9333-aad2c22035f2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] snapshot: 4a3188b1-c6dd-48ad-8e85-b08818d005ad, volume: b19ed93b-0777-4e4b-9333-aad2c22035f2,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[32581204-4ee8-4ebd-954f-2078b8700110]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:25 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad
Apr 24 14:51:25 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:25 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a" returned: 0 in 0.576s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:25 devstack sudo[89569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a
Apr 24 14:51:25 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:25 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad" returned: 0 in 0.526s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b31dedb3-f631-4398-b213-a06985cd82c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bcb296-7a69-462e-9b08-5e26e009d900]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:25 devstack sudo[89574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8
Apr 24 14:51:25 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:25 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-29449208-c471-4964-b03b-9483814fc89a" returned: 0 in 0.470s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Lock "cinder-quobyte-29449208-c471-4964-b03b-9483814fc89a" released by "delete_volume" :: held 1.090s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Created reservations ['66569a02-ca71-4a88-8815-7271126e74db', '1e52002f-33a5-48fd-b06d-693fa7532707', '3b6f80a5-36f0-48fe-8e88-37ba0c736334', 'e322ec08-07ab-46ab-a5cb-6ec9b558cbcc'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:26 devstack sudo[89577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:51:26 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:26 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8" returned: 0 in 0.543s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2 not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:26 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2
Apr 24 14:51:26 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:26 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.418s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:51:26 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Deleted volume successfully.
Apr 24 14:51:26 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-b634b3f3-b5fc-44c3-92e9-9d12837db695 tempest-VolumesNegativeTest-192208633 None] Lock "cinder-29449208-c471-4964-b03b-9483814fc89a-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:31 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2" returned: 0 in 4.971s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5b712b-211d-4ddb-8901-680cb88f77d9]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:31 devstack sudo[89595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8
Apr 24 14:51:31 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Flow 'volume_create_manager' (e7b975eb-033f-42c6-87db-846ffef6d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873dd224-fa62-406b-af8e-5e6a3aefb77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873dd224-fa62-406b-af8e-5e6a3aefb77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-831024976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834ea2c5-bf25-4139-bf1b-0427126c1ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36a4e3b38914ad592e4ae13f353cd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:32Z,use_quota=True,user_id='9350df1b57744a09b0ddc6701f26570b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bcaf60-ea3f-401e-9f6b-ef40ed5733f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bcaf60-ea3f-401e-9f6b-ef40ed5733f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a432efc-e117-4f0a-afee-d1a7b1748d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a432efc-e117-4f0a-afee-d1a7b1748d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '834ea2c5-bf25-4139-bf1b-0427126c1ff4', 'volume_name': 'volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4', 'volume_size': 2}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45facc42-91ec-454d-b41d-41080643995f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45facc42-91ec-454d-b41d-41080643995f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8662b3a3-c69e-4fd8-8810-9af8ba1db78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:31 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Volume 834ea2c5-bf25-4139-bf1b-0427126c1ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4', 'volume_size': 2}
Apr 24 14:51:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:32 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8" returned: 0 in 0.697s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2 {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:51:32 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Converted 1024.00 MB image at 205.95 MB/s
Apr 24 14:51:32 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2 is being set with open permissions: ugo+rw
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:32 devstack sudo[89600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2
Apr 24 14:51:32 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:32 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2" returned: 0 in 0.450s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-b19ed93b-0777-4e4b-9333-aad2c22035f2" released by "_copy_volume_from_snapshot" :: held 7.271s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-4a3188b1-c6dd-48ad-8e85-b08818d005ad-b19ed93b-0777-4e4b-9333-aad2c22035f2" released by "_create_volume_from_snapshot" :: held 7.301s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.324s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-831024976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834ea2c5-bf25-4139-bf1b-0427126c1ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36a4e3b38914ad592e4ae13f353cd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:32Z,use_quota=True,user_id='9350df1b57744a09b0ddc6701f26570b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Creating volume 834ea2c5-bf25-4139-bf1b-0427126c1ff4 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:51:32 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 2147483648 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:32 devstack sudo[89604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 2147483648
Apr 24 14:51:32 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180ef98c-6b61-47cf-9cca-9d9b1236bcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19ed93b-0777-4e4b-9333-aad2c22035f2', 'volume_size': 1, 'snapshot_id': '4a3188b1-c6dd-48ad-8e85-b08818d005ad'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9e77bd-7d85-4f12-a3c6-fd80e6273219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:32 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Volume volume-b19ed93b-0777-4e4b-9333-aad2c22035f2 (b19ed93b-0777-4e4b-9333-aad2c22035f2): created successfully
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9e77bd-7d85-4f12-a3c6-fd80e6273219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:32 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Flow 'volume_create_manager' (33240418-b37b-42cc-b7fb-bf6624e6d9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:32 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-90ad7a08-4f4a-4f37-9fb0-44d78ebc97b3 tempest-SnapshotDependencyTests-313609250 None] Created volume successfully.
Apr 24 14:51:33 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 2147483648" returned: 0 in 0.648s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:33 devstack sudo[89609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4
Apr 24 14:51:33 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:33 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4" returned: 0 in 0.428s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8662b3a3-c69e-4fd8-8810-9af8ba1db78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4', 'volume_size': 2}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16e68f8-03ad-4936-b86c-2bd22a7d7f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:33 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Volume volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 (834ea2c5-bf25-4139-bf1b-0427126c1ff4): created successfully
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16e68f8-03ad-4936-b86c-2bd22a7d7f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Flow 'volume_create_manager' (e7b975eb-033f-42c6-87db-846ffef6d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:33 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-204da2d6-53f6-4bad-baed-81225827b11d tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Created volume successfully.
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "cinder-4a3188b1-c6dd-48ad-8e85-b08818d005ad-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-4a3188b1-c6dd-48ad-8e85-b08818d005ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "cinder-quobyte-b31dedb3-f631-4398-b213-a06985cd82c8" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-b31dedb3-f631-4398-b213-a06985cd82c8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "cinder-quobyte-4a3188b1-c6dd-48ad-8e85-b08818d005ad" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-4a3188b1-c6dd-48ad-8e85-b08818d005ad" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Deleting offline snapshot 4a3188b1-c6dd-48ad-8e85-b08818d005ad of volume b31dedb3-f631-4398-b213-a06985cd82c8 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] snapshot_file for this snap is: volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c485241-548b-4db8-a99d-a9ddb01d5447]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:34 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad
Apr 24 14:51:34 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Creating offline snapshot f869a312-8dbb-4aeb-9b40-be5822293151 of volume 834ea2c5-bf25-4139-bf1b-0427126c1ff4 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:51:34 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbae7f8-1752-42df-87bc-86dacceb63b9]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:34 devstack sudo[89614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4
Apr 24 14:51:34 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:34 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad" returned: 0 in 0.558s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b31dedb3-f631-4398-b213-a06985cd82c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:51:34 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ea6a6b-5934-40c4-8a58-a81b41b9c706]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:34 devstack sudo[89619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8
Apr 24 14:51:34 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:34 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4" returned: 0 in 0.513s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151 2G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:34 devstack sudo[89624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151 2G
Apr 24 14:51:34 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:35 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8" returned: 0 in 0.533s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:35 devstack sudo[89631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad
Apr 24 14:51:35 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:35 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151 2G" returned: 0 in 0.599s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:35 devstack sudo[89634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151
Apr 24 14:51:35 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:35 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad" returned: 0 in 0.534s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:35 devstack sudo[89639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad
Apr 24 14:51:35 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:35 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151" returned: 0 in 0.486s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:35 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151 is being set with open permissions: ugo+rw
Apr 24 14:51:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:35 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151
Apr 24 14:51:35 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:35 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8.4a3188b1-c6dd-48ad-8e85-b08818d005ad" returned: 0 in 0.437s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-4a3188b1-c6dd-48ad-8e85-b08818d005ad" released by "_delete_snapshot" :: held 2.156s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-b31dedb3-f631-4398-b213-a06985cd82c8" released by "delete_snapshot" :: held 2.180s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:36 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Created reservations ['d21ea8f8-739f-46c4-96ea-efdc37d902cf', '121ad241-2c76-4139-960c-073495ae2e0d', '89038ad8-97b8-497b-8dbd-53fb76b042a7', 'e2dda4a0-3d0c-4601-81c2-7d2c51456005'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:51:36 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Delete snapshot completed successfully.
Apr 24 14:51:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-6c879c78-a97c-439e-8ee2-9c7eb3c2ea02 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-4a3188b1-c6dd-48ad-8e85-b08818d005ad-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:36 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151" returned: 0 in 0.463s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:36 devstack sudo[89648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.info
Apr 24 14:51:36 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:36 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.info" returned: 0 in 0.443s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:36 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.info is being set with open permissions: ugo+rw
Apr 24 14:51:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:36 devstack sudo[89651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.info
Apr 24 14:51:36 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:36 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "cinder-b31dedb3-f631-4398-b213-a06985cd82c8-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-b31dedb3-f631-4398-b213-a06985cd82c8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "cinder-quobyte-b31dedb3-f631-4398-b213-a06985cd82c8" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:37 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-b31dedb3-f631-4398-b213-a06985cd82c8" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:37 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09043f3-4bd6-4d9c-8bf4-c7fe739b6568]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:37 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:37 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8
Apr 24 14:51:37 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.info" returned: 0 in 0.506s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.094s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:37 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d4d7f7d8-42dc-46e3-8fe0-5cdf30a8a725 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Create snapshot completed successfully
Apr 24 14:51:37 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8" returned: 0 in 0.504s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:37 devstack sudo[89659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8
Apr 24 14:51:37 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:38 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b31dedb3-f631-4398-b213-a06985cd82c8" returned: 0 in 0.411s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-b31dedb3-f631-4398-b213-a06985cd82c8" released by "delete_volume" :: held 0.973s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Created reservations ['9f2840b0-e191-4c97-b193-8723777e56ca', '3f385023-47d6-47ac-811e-f2eba0331f16', '60a1b65e-2580-4ea3-bc98-08f437ac1cf4', 'b49c53de-24c8-4b48-84f2-b094f3eebdf3'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:38 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:51:38 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Acquiring lock "cinder-f869a312-8dbb-4aeb-9b40-be5822293151-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "cinder-f869a312-8dbb-4aeb-9b40-be5822293151-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Acquiring lock "cinder-quobyte-834ea2c5-bf25-4139-bf1b-0427126c1ff4" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "cinder-quobyte-834ea2c5-bf25-4139-bf1b-0427126c1ff4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Acquiring lock "cinder-quobyte-f869a312-8dbb-4aeb-9b40-be5822293151" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "cinder-quobyte-f869a312-8dbb-4aeb-9b40-be5822293151" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Deleting offline snapshot f869a312-8dbb-4aeb-9b40-be5822293151 of volume 834ea2c5-bf25-4139-bf1b-0427126c1ff4 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] snapshot_file for this snap is: volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba2cf73-49aa-41c8-a994-f0567b608bcc]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:38 devstack sudo[89664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151
Apr 24 14:51:38 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:38 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.472s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:51:38 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Deleted volume successfully.
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-75983220-8ca6-4550-81d2-4a1e39611d25 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-b31dedb3-f631-4398-b213-a06985cd82c8-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:38 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151" returned: 0 in 0.511s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b58638-292a-47af-a9db-f2067bd22eac]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:39 devstack sudo[89670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4
Apr 24 14:51:39 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "cinder-b19ed93b-0777-4e4b-9333-aad2c22035f2-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-b19ed93b-0777-4e4b-9333-aad2c22035f2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "cinder-quobyte-b19ed93b-0777-4e4b-9333-aad2c22035f2" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:39 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-b19ed93b-0777-4e4b-9333-aad2c22035f2" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:39 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6218128-33b0-4da2-a584-bd56bc1b54c0]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:39 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2
Apr 24 14:51:39 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:39 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4" returned: 0 in 0.528s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:39 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151
Apr 24 14:51:39 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:39 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2" returned: 0 in 0.509s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:39 devstack sudo[89682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2
Apr 24 14:51:39 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:40 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151" returned: 0 in 0.528s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:40 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151
Apr 24 14:51:40 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:40 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b19ed93b-0777-4e4b-9333-aad2c22035f2" returned: 0 in 0.454s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-quobyte-b19ed93b-0777-4e4b-9333-aad2c22035f2" released by "delete_volume" :: held 1.004s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Created reservations ['c5c524c4-3792-4627-90f7-832580dcbd49', 'c9802422-07bf-4f15-ab7d-0ff0a790acb8', '3f4457ae-e763-46d5-8c59-6990c3d25dcd', '124f7b27-1228-43ae-b78f-8a5c94883657'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:40 devstack sudo[89690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:51:40 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:40 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4.f869a312-8dbb-4aeb-9b40-be5822293151" returned: 0 in 0.488s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "cinder-quobyte-f869a312-8dbb-4aeb-9b40-be5822293151" released by "_delete_snapshot" :: held 2.158s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "cinder-quobyte-834ea2c5-bf25-4139-bf1b-0427126c1ff4" released by "delete_snapshot" :: held 2.182s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Created reservations ['67128854-197d-4c74-a336-887ab22460e2', 'a6db0c6c-e0ce-4526-9ab8-b758ad7e133a', '2f38b134-c9fc-4040-a2d4-6435021bbbf1', '8925cc3f-7c09-471c-bc14-5edfbc6708fa'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:51:40 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Delete snapshot completed successfully.
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e4263c9f-921f-4935-9625-a98973246fd7 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "cinder-f869a312-8dbb-4aeb-9b40-be5822293151-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:40 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.480s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:51:40 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Deleted volume successfully.
Apr 24 14:51:40 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68e3d1fb-d694-41bc-be08-53a05aff1810 tempest-SnapshotDependencyTests-313609250 None] Lock "cinder-b19ed93b-0777-4e4b-9333-aad2c22035f2-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Acquiring lock "cinder-834ea2c5-bf25-4139-bf1b-0427126c1ff4-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "cinder-834ea2c5-bf25-4139-bf1b-0427126c1ff4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Acquiring lock "cinder-quobyte-834ea2c5-bf25-4139-bf1b-0427126c1ff4" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:51:41 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "cinder-quobyte-834ea2c5-bf25-4139-bf1b-0427126c1ff4" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:51:41 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffeed24-66f9-4e89-a253-4cf907e6b8f5]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:51:41 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:41 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4
Apr 24 14:51:41 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:42 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4" returned: 0 in 0.552s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:42 devstack sudo[89699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4
Apr 24 14:51:42 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:42 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-834ea2c5-bf25-4139-bf1b-0427126c1ff4" returned: 0 in 0.470s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:42 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "cinder-quobyte-834ea2c5-bf25-4139-bf1b-0427126c1ff4" released by "delete_volume" :: held 1.093s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:42 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Created reservations ['afff299f-6958-4215-84a8-e86e0c68a56c', '41d96a72-b5d5-478d-ab6d-1747a03f53b7', '7d60696a-3dbb-421c-ac2b-b97ec8a4a819', '60c812bc-1ecf-45a1-ae54-a6256a49ae82'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:51:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:51:42 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:51:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:42 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:42 devstack sudo[89704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:51:42 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:43 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.493s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:43 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Deleted volume successfully.
Apr 24 14:51:43 devstack sudo[89707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:51:43 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-c3a5478c-b86f-4819-adcd-8ceda7da5427 tempest-VolumesSnapshotNegativeTestJSON-1311472800 None] Lock "cinder-834ea2c5-bf25-4139-bf1b-0427126c1ff4-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:51:43 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.481s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:43 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:51:52 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=44,cinder:UPDATE=58,cinder:INSERT=16,cinder:DELETE=4 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:51:53 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:UPDATE=51,cinder:SELECT=46,cinder:INSERT=12,cinder:DELETE=5 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (c953b653-89ca-47e9-920d-b4b9be3e0792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a272bebd-67b7-4f93-9f81-b2823a83a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a272bebd-67b7-4f93-9f81-b2823a83a24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112957171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b5393d-f5e9-4625-801a-87bb189ba1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:57Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdfea20-b4d4-4bb7-9786-390df5cb7742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdfea20-b4d4-4bb7-9786-390df5cb7742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8aa50b-2c24-48cf-a7d9-23b4abe53887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8aa50b-2c24-48cf-a7d9-23b4abe53887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0b5393d-f5e9-4625-801a-87bb189ba1c8', 'volume_name': 'volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b53e8c1-c67d-4bf2-9343-c1b8196b2b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b53e8c1-c67d-4bf2-9343-c1b8196b2b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8cbda0-70bc-444e-a6e7-a82dc8556e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume f0b5393d-f5e9-4625-801a-87bb189ba1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8', 'volume_size': 1}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112957171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b5393d-f5e9-4625-801a-87bb189ba1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:57Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Creating volume f0b5393d-f5e9-4625-801a-87bb189ba1c8 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:51:57 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:57 devstack sudo[89764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8 1073741824
Apr 24 14:51:57 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Flow 'volume_create_manager' (9542a94c-cadd-4679-8804-3b571e52b4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6259e0-ad5b-4141-a36e-e1b0a6d11321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6259e0-ad5b-4141-a36e-e1b0a6d11321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-672705398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d0d57f-aa1c-457d-8388-1c400e5a8151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c767f0ffa85844d3a2a02071ed94f86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:57Z,use_quota=True,user_id='633f2bc2ab994e0ebeddb8133852f4f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b374c573-dca2-42bb-9da2-94c0d818e069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b374c573-dca2-42bb-9da2-94c0d818e069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4b239d-9631-4a97-b103-a2d9b65745cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4b239d-9631-4a97-b103-a2d9b65745cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d0d57f-aa1c-457d-8388-1c400e5a8151', 'volume_name': 'volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce66a6a5-6206-4dbe-87b8-d03e275d8c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce66a6a5-6206-4dbe-87b8-d03e275d8c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa24548-7335-4422-a896-918d4dde2e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Volume c1d0d57f-aa1c-457d-8388-1c400e5a8151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151', 'volume_size': 1}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Flow 'volume_create_manager' (9a8a0be0-f1af-4dc4-9486-548a56096d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78162bd7-ab35-413f-8daa-4de8d5110a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78162bd7-ab35-413f-8daa-4de8d5110a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-170787386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e951df-8747-41c0-876e-20fcafef0841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b11e4a5f4834c87a3d6b071ea00645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:57Z,use_quota=True,user_id='bdf1ebcf35a84047aa5725def545b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54862090-7d08-4fa0-8458-35aa626e6975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54862090-7d08-4fa0-8458-35aa626e6975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f2ba59-52a2-4830-8089-8fbaa0dca7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f2ba59-52a2-4830-8089-8fbaa0dca7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e951df-8747-41c0-876e-20fcafef0841', 'volume_name': 'volume-13e951df-8747-41c0-876e-20fcafef0841', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6683319a-5e17-44ca-b1e9-33dd7b4b3eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6683319a-5e17-44ca-b1e9-33dd7b4b3eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84660315-b9c3-4a82-a3da-0eec32ff7946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Volume 13e951df-8747-41c0-876e-20fcafef0841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e951df-8747-41c0-876e-20fcafef0841', 'volume_size': 1}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Flow 'volume_create_manager' (d9aedfa1-fa12-4f47-9220-975208670611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a55706-8a4b-4f14-804c-1aa683256a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a55706-8a4b-4f14-804c-1aa683256a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1996610616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553bcea7-596a-4c23-a3d0-34ed00748a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b11e4a5f4834c87a3d6b071ea00645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:58Z,use_quota=True,user_id='bdf1ebcf35a84047aa5725def545b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9ed6cd-6eb2-4b70-bdcf-41fdd0ba339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9ed6cd-6eb2-4b70-bdcf-41fdd0ba339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5843226c-b8ed-4245-820f-e8bbdeb7da71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5843226c-b8ed-4245-820f-e8bbdeb7da71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553bcea7-596a-4c23-a3d0-34ed00748a8b', 'volume_name': 'volume-553bcea7-596a-4c23-a3d0-34ed00748a8b', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641c3809-ac83-4aef-bacf-486d2035d1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641c3809-ac83-4aef-bacf-486d2035d1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5da975-a2c5-464c-bfc0-3f8d636b8ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:57 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Volume 553bcea7-596a-4c23-a3d0-34ed00748a8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553bcea7-596a-4c23-a3d0-34ed00748a8b', 'volume_size': 1}
Apr 24 14:51:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:58 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8 1073741824" returned: 0 in 0.854s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:58 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8
Apr 24 14:51:58 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Flow 'volume_create_manager' (9d98e0e7-3375-481c-a421-01ac2567f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea732857-202c-4313-89fc-4e8d3569ca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea732857-202c-4313-89fc-4e8d3569ca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-239326025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7070e5e-819f-4f92-a7e0-42c3e73f1670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b11e4a5f4834c87a3d6b071ea00645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:58Z,use_quota=True,user_id='bdf1ebcf35a84047aa5725def545b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f64f5b8-d02c-4c9c-b21d-65ccac3e874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f64f5b8-d02c-4c9c-b21d-65ccac3e874c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24aa3706-a50d-46ea-a284-2d40dbd13fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24aa3706-a50d-46ea-a284-2d40dbd13fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7070e5e-819f-4f92-a7e0-42c3e73f1670', 'volume_name': 'volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4cd2d2-3cb4-4946-992e-e5b1bdb2dbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4cd2d2-3cb4-4946-992e-e5b1bdb2dbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2773394-0673-4e56-b950-15a7f81b25c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Volume b7070e5e-819f-4f92-a7e0-42c3e73f1670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670', 'volume_size': 1}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Flow 'volume_create_manager' (1e7c3fc0-34c8-436e-ba66-39d3d260861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b9db37-7ce8-42fe-bf52-2773a53664d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b9db37-7ce8-42fe-bf52-2773a53664d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-77949063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57a1cde-2dd6-4992-8433-e247ee0250cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b11e4a5f4834c87a3d6b071ea00645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:59Z,use_quota=True,user_id='bdf1ebcf35a84047aa5725def545b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fedab6-d7c5-435b-b567-f71cfb5efaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fedab6-d7c5-435b-b567-f71cfb5efaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b4ec384-3c6b-4d5b-8f95-53708c9caa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b4ec384-3c6b-4d5b-8f95-53708c9caa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57a1cde-2dd6-4992-8433-e247ee0250cb', 'volume_name': 'volume-c57a1cde-2dd6-4992-8433-e247ee0250cb', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35291820-5d27-46b7-9806-19386e50381d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35291820-5d27-46b7-9806-19386e50381d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f14e84d-0966-423b-88ff-ebf3019f7eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Volume c57a1cde-2dd6-4992-8433-e247ee0250cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57a1cde-2dd6-4992-8433-e247ee0250cb', 'volume_size': 1}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8" returned: 0 in 0.578s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-672705398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d0d57f-aa1c-457d-8388-1c400e5a8151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c767f0ffa85844d3a2a02071ed94f86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:57Z,use_quota=True,user_id='633f2bc2ab994e0ebeddb8133852f4f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Creating volume c1d0d57f-aa1c-457d-8388-1c400e5a8151 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:51:58 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8cbda0-70bc-444e-a6e7-a82dc8556e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ab4dd0-6112-4bcb-acf6-bdf3cf7a0563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8 (f0b5393d-f5e9-4625-801a-87bb189ba1c8): created successfully
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ab4dd0-6112-4bcb-acf6-bdf3cf7a0563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 1073741824
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (c953b653-89ca-47e9-920d-b4b9be3e0792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:58 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:58 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-348f0fbb-039c-4e6e-a6c9-0e5921d91215 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created volume successfully.
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Flow 'volume_create_manager' (2ca84d5e-0a77-40ca-9ca4-64f23250bd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a907619-9a95-48c2-98a6-bfc4cd3b38e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a907619-9a95-48c2-98a6-bfc4cd3b38e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-911134795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c7c311-3edc-4cfc-ab19-43913c20ad11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b11e4a5f4834c87a3d6b071ea00645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:59Z,use_quota=True,user_id='bdf1ebcf35a84047aa5725def545b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12573d5-a17f-49ba-8230-8c0aa8088d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12573d5-a17f-49ba-8230-8c0aa8088d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36120686-d031-43b2-8d30-b75e83a23e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36120686-d031-43b2-8d30-b75e83a23e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c7c311-3edc-4cfc-ab19-43913c20ad11', 'volume_name': 'volume-25c7c311-3edc-4cfc-ab19-43913c20ad11', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcee8cf-e04e-4b9b-bf58-4f0d3bb78042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:58 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcee8cf-e04e-4b9b-bf58-4f0d3bb78042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c4533a-3133-4407-b827-1dd0ee2f0deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:59 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Volume 25c7c311-3edc-4cfc-ab19-43913c20ad11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c7c311-3edc-4cfc-ab19-43913c20ad11', 'volume_size': 1}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:59 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 1073741824" returned: 0 in 0.816s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (ad2edda4-05fc-4c46-8db4-e02da4426525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560893a6-0138-425b-993c-a4b6fe4f6839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560893a6-0138-425b-993c-a4b6fe4f6839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289782113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59793e1-1759-4782-a89a-6bdbc2ad6fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:00Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca1172a-972d-4ee2-8355-7e0fb33807f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:59 devstack sudo[89777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151
Apr 24 14:51:59 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca1172a-972d-4ee2-8355-7e0fb33807f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5625a99-c366-47aa-a2e7-5541227a4d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5625a99-c366-47aa-a2e7-5541227a4d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a59793e1-1759-4782-a89a-6bdbc2ad6fee', 'volume_name': 'volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0c2cb5-9765-423f-b63d-649beabb2555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0c2cb5-9765-423f-b63d-649beabb2555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77591c89-b5fe-4f96-89cc-c122b53dc47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:59 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume a59793e1-1759-4782-a89a-6bdbc2ad6fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee', 'volume_size': 1}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (49c6c94f-fb8f-46c0-af81-d5362e49e10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9c90b1-f870-4005-bd02-e258f08fa108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9c90b1-f870-4005-bd02-e258f08fa108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752487389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6932c480-0467-4239-b11b-bb9dd47c9f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:00Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c940df-9474-4d77-9709-0ca3b3a5bed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c940df-9474-4d77-9709-0ca3b3a5bed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc7eaf6-4e15-4f9d-a9ed-34e7bc0abae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:51:59 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc7eaf6-4e15-4f9d-a9ed-34e7bc0abae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6932c480-0467-4239-b11b-bb9dd47c9f8c', 'volume_name': 'volume-6932c480-0467-4239-b11b-bb9dd47c9f8c', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66ce2f7-b0dc-4c39-8e2e-db4f63cb406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66ce2f7-b0dc-4c39-8e2e-db4f63cb406d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c19a6b-4926-4223-83d1-54b754bed538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume 6932c480-0467-4239-b11b-bb9dd47c9f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6932c480-0467-4239-b11b-bb9dd47c9f8c', 'volume_size': 1}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (6672d50d-b8f3-44c4-b4db-78a00a880246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc29723-fbfe-4686-bd94-dfb4367cdc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc29723-fbfe-4686-bd94-dfb4367cdc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1479599722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703cf045-181c-420e-9253-f49b4484ac34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:00Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9fc4de2-5802-4d8b-9c99-527cd853e9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9fc4de2-5802-4d8b-9c99-527cd853e9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdda4e7-d784-4ccc-8dc6-82654ce57227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdda4e7-d784-4ccc-8dc6-82654ce57227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '703cf045-181c-420e-9253-f49b4484ac34', 'volume_name': 'volume-703cf045-181c-420e-9253-f49b4484ac34', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b74a3b6-f63d-4c3d-ac34-bae35ce571cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b74a3b6-f63d-4c3d-ac34-bae35ce571cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031abe61-2a35-4400-b5cc-a99d6e47f670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume 703cf045-181c-420e-9253-f49b4484ac34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-703cf045-181c-420e-9253-f49b4484ac34', 'volume_size': 1}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:00 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151" returned: 0 in 0.599s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.635s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-170787386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e951df-8747-41c0-876e-20fcafef0841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b11e4a5f4834c87a3d6b071ea00645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:57Z,use_quota=True,user_id='bdf1ebcf35a84047aa5725def545b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Creating volume 13e951df-8747-41c0-876e-20fcafef0841 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:00 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa24548-7335-4422-a896-918d4dde2e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8f53b6-ca95-4429-aad9-c88b07e8cac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack sudo[89780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841 1073741824
Apr 24 14:52:00 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Volume volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 (c1d0d57f-aa1c-457d-8388-1c400e5a8151): created successfully
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8f53b6-ca95-4429-aad9-c88b07e8cac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Flow 'volume_create_manager' (9542a94c-cadd-4679-8804-3b571e52b4f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:00 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-6ac39d8b-7728-4956-9265-7b7cddeaddfe tempest-VolumeDependencyTests-1782512249 None] Created volume successfully.
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (93aeb0e1-9342-4d8a-87bb-7065ce7966f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283417be-ea68-41b7-9982-62a775564206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283417be-ea68-41b7-9982-62a775564206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678000632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a173e531-88d3-43e1-8c71-e6133be96900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:01Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519a29be-2ab8-4187-b873-0958ae59cb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519a29be-2ab8-4187-b873-0958ae59cb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef63e6d2-980f-45b8-bdaa-81f5373f9bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef63e6d2-980f-45b8-bdaa-81f5373f9bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a173e531-88d3-43e1-8c71-e6133be96900', 'volume_name': 'volume-a173e531-88d3-43e1-8c71-e6133be96900', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba450ad-ffb5-4be3-af4b-204db69d26ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba450ad-ffb5-4be3-af4b-204db69d26ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3087554-d56c-4abf-a3b9-cccfd427c979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume a173e531-88d3-43e1-8c71-e6133be96900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a173e531-88d3-43e1-8c71-e6133be96900', 'volume_size': 1}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (4c0deca3-3f2a-4594-af94-4bb2fd7430d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001a6c28-83d3-434b-b3d7-6d46145ee94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001a6c28-83d3-434b-b3d7-6d46145ee94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894690058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd15988c-b908-42ed-8892-52681ad3ac05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:01Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f303e1-f4a3-4be0-92d5-9ae55fa5e9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f303e1-f4a3-4be0-92d5-9ae55fa5e9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88738934-2aeb-409a-a599-6c47597641aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88738934-2aeb-409a-a599-6c47597641aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd15988c-b908-42ed-8892-52681ad3ac05', 'volume_name': 'volume-cd15988c-b908-42ed-8892-52681ad3ac05', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19240ab-b5e5-4400-a425-2d2f0557a06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19240ab-b5e5-4400-a425-2d2f0557a06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb86e910-68e9-47b4-b8ec-4c49b4ac4a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:00 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume cd15988c-b908-42ed-8892-52681ad3ac05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd15988c-b908-42ed-8892-52681ad3ac05', 'volume_size': 1}
Apr 24 14:52:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:01 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841 1073741824" returned: 0 in 0.818s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:01 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841
Apr 24 14:52:01 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:01 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841" returned: 0 in 0.547s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.745s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1996610616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553bcea7-596a-4c23-a3d0-34ed00748a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b11e4a5f4834c87a3d6b071ea00645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:58Z,use_quota=True,user_id='bdf1ebcf35a84047aa5725def545b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Creating volume 553bcea7-596a-4c23-a3d0-34ed00748a8b {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:01 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84660315-b9c3-4a82-a3da-0eec32ff7946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e951df-8747-41c0-876e-20fcafef0841', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:01 devstack sudo[89788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b 1073741824
Apr 24 14:52:01 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f30fdb6-367d-4e93-baec-5ca447ddcb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:01 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Volume volume-13e951df-8747-41c0-876e-20fcafef0841 (13e951df-8747-41c0-876e-20fcafef0841): created successfully
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f30fdb6-367d-4e93-baec-5ca447ddcb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Flow 'volume_create_manager' (9a8a0be0-f1af-4dc4-9486-548a56096d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:01 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1a700cfd-119b-4a56-b377-348eb7e32b3b tempest-CreateVolumesFromImageTest-1477660909 None] Created volume successfully.
Apr 24 14:52:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:02 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b 1073741824" returned: 0 in 0.746s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:02 devstack sudo[89794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b
Apr 24 14:52:02 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:02 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b" returned: 0 in 0.483s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.544s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-239326025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7070e5e-819f-4f92-a7e0-42c3e73f1670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b11e4a5f4834c87a3d6b071ea00645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:58Z,use_quota=True,user_id='bdf1ebcf35a84047aa5725def545b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Creating volume b7070e5e-819f-4f92-a7e0-42c3e73f1670 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:02 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5da975-a2c5-464c-bfc0-3f8d636b8ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553bcea7-596a-4c23-a3d0-34ed00748a8b', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af963d16-1c67-403b-980b-86cdf93dadc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:02 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Volume volume-553bcea7-596a-4c23-a3d0-34ed00748a8b (553bcea7-596a-4c23-a3d0-34ed00748a8b): created successfully
Apr 24 14:52:02 devstack sudo[89797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670 1073741824
Apr 24 14:52:02 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af963d16-1c67-403b-980b-86cdf93dadc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:02 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Flow 'volume_create_manager' (d9aedfa1-fa12-4f47-9220-975208670611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:02 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-943a3132-982e-481c-ad28-f5da3dd96ca8 tempest-CreateVolumesFromImageTest-1477660909 None] Created volume successfully.
Apr 24 14:52:03 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670 1073741824" returned: 0 in 0.656s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:03 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670
Apr 24 14:52:03 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:04 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670" returned: 0 in 0.514s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.452s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-77949063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57a1cde-2dd6-4992-8433-e247ee0250cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b11e4a5f4834c87a3d6b071ea00645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:59Z,use_quota=True,user_id='bdf1ebcf35a84047aa5725def545b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Creating volume c57a1cde-2dd6-4992-8433-e247ee0250cb {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:04 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:04 devstack sudo[89805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb 1073741824
Apr 24 14:52:04 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2773394-0673-4e56-b950-15a7f81b25c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523a702a-9cb6-4a03-bd48-a2d0f10602d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:04 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Volume volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670 (b7070e5e-819f-4f92-a7e0-42c3e73f1670): created successfully
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523a702a-9cb6-4a03-bd48-a2d0f10602d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Flow 'volume_create_manager' (9d98e0e7-3375-481c-a421-01ac2567f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:04 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-653eb77d-d6cd-47de-9383-3783e6d240ae tempest-CreateVolumesFromImageTest-1477660909 None] Created volume successfully.
Apr 24 14:52:04 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb 1073741824" returned: 0 in 0.771s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:04 devstack sudo[89810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb
Apr 24 14:52:04 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:05 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb" returned: 0 in 0.481s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.432s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-911134795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c7c311-3edc-4cfc-ab19-43913c20ad11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b11e4a5f4834c87a3d6b071ea00645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:51:59Z,use_quota=True,user_id='bdf1ebcf35a84047aa5725def545b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Creating volume 25c7c311-3edc-4cfc-ab19-43913c20ad11 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:05 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:05 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11 1073741824
Apr 24 14:52:05 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f14e84d-0966-423b-88ff-ebf3019f7eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57a1cde-2dd6-4992-8433-e247ee0250cb', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bc1f1a-5aa8-42f7-8254-5079d66cf992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:05 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Volume volume-c57a1cde-2dd6-4992-8433-e247ee0250cb (c57a1cde-2dd6-4992-8433-e247ee0250cb): created successfully
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bc1f1a-5aa8-42f7-8254-5079d66cf992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:05 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Flow 'volume_create_manager' (1e7c3fc0-34c8-436e-ba66-39d3d260861d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:05 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-21a9c79b-48d2-4b68-9410-b42aee9a7a3a tempest-CreateVolumesFromImageTest-1477660909 None] Created volume successfully.
Apr 24 14:52:06 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11 1073741824" returned: 0 in 0.719s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:06 devstack sudo[89818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11
Apr 24 14:52:06 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:06 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11" returned: 0 in 0.456s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.992s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289782113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59793e1-1759-4782-a89a-6bdbc2ad6fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:00Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Creating volume a59793e1-1759-4782-a89a-6bdbc2ad6fee {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:06 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:06 devstack sudo[89821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee 1073741824
Apr 24 14:52:06 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c4533a-3133-4407-b827-1dd0ee2f0deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c7c311-3edc-4cfc-ab19-43913c20ad11', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c063777f-9baa-409d-8310-c8d157f4f6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:06 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Volume volume-25c7c311-3edc-4cfc-ab19-43913c20ad11 (25c7c311-3edc-4cfc-ab19-43913c20ad11): created successfully
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c063777f-9baa-409d-8310-c8d157f4f6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:06 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Flow 'volume_create_manager' (2ca84d5e-0a77-40ca-9ca4-64f23250bd31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:06 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-15c6279f-6383-41ca-9d0a-26b8ae9d1a09 tempest-CreateVolumesFromImageTest-1477660909 None] Created volume successfully.
Apr 24 14:52:07 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee 1073741824" returned: 0 in 0.663s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:07 devstack sudo[89826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee
Apr 24 14:52:07 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "cinder-25c7c311-3edc-4cfc-ab19-43913c20ad11-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-25c7c311-3edc-4cfc-ab19-43913c20ad11-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "cinder-quobyte-25c7c311-3edc-4cfc-ab19-43913c20ad11" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-quobyte-25c7c311-3edc-4cfc-ab19-43913c20ad11" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:07 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[243a5772-dfc6-4364-a401-5617567eb17f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:08 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee" returned: 0 in 0.650s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:08 devstack sudo[89829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11
Apr 24 14:52:08 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.016s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752487389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6932c480-0467-4239-b11b-bb9dd47c9f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:00Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Creating volume 6932c480-0467-4239-b11b-bb9dd47c9f8c {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:08 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77591c89-b5fe-4f96-89cc-c122b53dc47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:08 devstack sudo[89831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c 1073741824
Apr 24 14:52:08 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109adc73-cb02-44af-bf7d-e0ee241cd4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:08 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee (a59793e1-1759-4782-a89a-6bdbc2ad6fee): created successfully
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109adc73-cb02-44af-bf7d-e0ee241cd4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (ad2edda4-05fc-4c46-8db4-e02da4426525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:08 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-134a1922-be69-47ac-97f6-4921c8c11086 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created volume successfully.
Apr 24 14:52:08 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11" returned: 0 in 0.625s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:08 devstack sudo[89839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11
Apr 24 14:52:08 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:08 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c 1073741824" returned: 0 in 0.693s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:08 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c
Apr 24 14:52:08 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:09 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-25c7c311-3edc-4cfc-ab19-43913c20ad11" returned: 0 in 0.506s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-quobyte-25c7c311-3edc-4cfc-ab19-43913c20ad11" released by "delete_volume" :: held 1.189s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Created reservations ['68b76386-5568-44d6-979b-fbe5f5eae4fb', '9e945ba6-5f6e-48aa-a5aa-f6d743c73f3f', '5354a81b-0956-4e9b-a23b-5448182beaa9', 'e226d390-f8f7-4fd4-8655-e86af63a2730'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:09 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:09 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:09 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c" returned: 0 in 0.557s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.153s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1479599722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703cf045-181c-420e-9253-f49b4484ac34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:00Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Creating volume 703cf045-181c-420e-9253-f49b4484ac34 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:09 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c19a6b-4926-4223-83d1-54b754bed538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6932c480-0467-4239-b11b-bb9dd47c9f8c', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:09 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34 1073741824
Apr 24 14:52:09 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d02698b-de97-4932-ab11-0d7b9be06ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:09 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume volume-6932c480-0467-4239-b11b-bb9dd47c9f8c (6932c480-0467-4239-b11b-bb9dd47c9f8c): created successfully
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d02698b-de97-4932-ab11-0d7b9be06ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (49c6c94f-fb8f-46c0-af81-d5362e49e10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:09 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-5e98167f-675b-446e-9a26-8260981ad7a4 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created volume successfully.
Apr 24 14:52:09 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.556s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:09 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Deleted volume successfully.
Apr 24 14:52:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e566c4bc-99a9-4e0b-b58c-7cfedf5e277f tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-25c7c311-3edc-4cfc-ab19-43913c20ad11-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "cinder-c57a1cde-2dd6-4992-8433-e247ee0250cb-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:10 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34 1073741824" returned: 0 in 0.777s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-c57a1cde-2dd6-4992-8433-e247ee0250cb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "cinder-quobyte-c57a1cde-2dd6-4992-8433-e247ee0250cb" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:10 devstack sudo[89854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34
Apr 24 14:52:10 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-quobyte-c57a1cde-2dd6-4992-8433-e247ee0250cb" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79e5e0d-28d8-4deb-8ce2-9679ef9c6052]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:10 devstack sudo[89856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb
Apr 24 14:52:10 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:10 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34" returned: 0 in 0.509s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678000632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a173e531-88d3-43e1-8c71-e6133be96900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:01Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Creating volume a173e531-88d3-43e1-8c71-e6133be96900 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:10 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031abe61-2a35-4400-b5cc-a99d6e47f670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703cf045-181c-420e-9253-f49b4484ac34', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027c61ae-166a-437f-91e5-69e289b363e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:10 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume volume-703cf045-181c-420e-9253-f49b4484ac34 (703cf045-181c-420e-9253-f49b4484ac34): created successfully
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027c61ae-166a-437f-91e5-69e289b363e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:10 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900 1073741824
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (6672d50d-b8f3-44c4-b4db-78a00a880246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:10 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:10 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-c7edd212-0159-4612-abef-455b0807b832 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created volume successfully.
Apr 24 14:52:10 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb" returned: 0 in 0.634s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:10 devstack sudo[89864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb
Apr 24 14:52:10 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:11 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c57a1cde-2dd6-4992-8433-e247ee0250cb" returned: 0 in 0.564s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:11 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900 1073741824" returned: 0 in 0.739s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-quobyte-c57a1cde-2dd6-4992-8433-e247ee0250cb" released by "delete_volume" :: held 1.254s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:11 devstack sudo[89870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900
Apr 24 14:52:11 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:11 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Created reservations ['d1461bf2-5f7e-4aa6-944c-ec45c476aef8', 'e23ef5f2-c758-4ecc-80c3-7304ef51963f', 'c49426d1-dbd7-4a84-a8d6-363ea889a337', '8dc579e8-72a4-4409-bd0c-2cc5e26cc175'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:11 devstack sudo[89872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:11 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:11 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900" returned: 0 in 0.478s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.118s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894690058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd15988c-b908-42ed-8892-52681ad3ac05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a17d2682854dfa95d12ffa800760f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:01Z,use_quota=True,user_id='16eb829dcf7d4331ad66f205f68fc31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Creating volume cd15988c-b908-42ed-8892-52681ad3ac05 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:12 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3087554-d56c-4abf-a3b9-cccfd427c979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a173e531-88d3-43e1-8c71-e6133be96900', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6499ca5e-6109-4240-86b1-24bdd951df53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:12 devstack sudo[89875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05 1073741824
Apr 24 14:52:12 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:12 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume volume-a173e531-88d3-43e1-8c71-e6133be96900 (a173e531-88d3-43e1-8c71-e6133be96900): created successfully
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6499ca5e-6109-4240-86b1-24bdd951df53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (93aeb0e1-9342-4d8a-87bb-7065ce7966f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:12 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d4d8b910-67fb-4c0f-a3a1-a607f576f2ec tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created volume successfully.
Apr 24 14:52:12 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.516s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:12 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Deleted volume successfully.
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-7c1cee9e-1daf-4937-ab0b-2d36b5d763b4 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-c57a1cde-2dd6-4992-8433-e247ee0250cb-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "cinder-b7070e5e-819f-4f92-a7e0-42c3e73f1670-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-b7070e5e-819f-4f92-a7e0-42c3e73f1670-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "cinder-quobyte-b7070e5e-819f-4f92-a7e0-42c3e73f1670" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-quobyte-b7070e5e-819f-4f92-a7e0-42c3e73f1670" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[048ccfe2-3cc3-4df3-a793-cdd1da79fbf5]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:12 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670
Apr 24 14:52:12 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:12 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05 1073741824" returned: 0 in 0.728s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:12 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05
Apr 24 14:52:12 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:13 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670" returned: 0 in 0.622s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:13 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670
Apr 24 14:52:13 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:13 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05" returned: 0 in 0.636s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.588s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb86e910-68e9-47b4-b8ec-4c49b4ac4a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd15988c-b908-42ed-8892-52681ad3ac05', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca97195-4437-4ce4-b742-fbf3b29aeeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] Creating offline snapshot 73074865-fd1f-4c1d-be2d-9c5c3dcae0ee of volume c1d0d57f-aa1c-457d-8388-1c400e5a8151 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:52:13 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Volume volume-cd15988c-b908-42ed-8892-52681ad3ac05 (cd15988c-b908-42ed-8892-52681ad3ac05): created successfully
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca97195-4437-4ce4-b742-fbf3b29aeeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Flow 'volume_create_manager' (4c0deca3-3f2a-4594-af94-4bb2fd7430d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabe37b7-d03c-48ae-9262-c43f7aab927f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:13 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-67a8c4c5-0ec3-49ab-a6b2-8284ace80663 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created volume successfully.
Apr 24 14:52:13 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-b7070e5e-819f-4f92-a7e0-42c3e73f1670" returned: 0 in 0.516s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:13 devstack sudo[89892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151
Apr 24 14:52:13 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-quobyte-b7070e5e-819f-4f92-a7e0-42c3e73f1670" released by "delete_volume" :: held 1.179s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Created reservations ['f7fe18bf-d1d2-4202-86b0-d2024f4231b6', '01d0be34-049c-4710-826c-029828e623b2', 'a46b80b6-c7a5-4bbb-82e5-a89c9a41e3f3', 'a414faec-dad5-400d-b9fb-db23a2083cad'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:13 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:13 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-cd15988c-b908-42ed-8892-52681ad3ac05-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-cd15988c-b908-42ed-8892-52681ad3ac05-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-quobyte-cd15988c-b908-42ed-8892-52681ad3ac05" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-cd15988c-b908-42ed-8892-52681ad3ac05" acquired by "delete_volume" :: waited 0.031s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dec6cdc-db9e-4ecb-82b2-abe62e51a199]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:14 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151" returned: 0 in 0.733s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:14 devstack sudo[89900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05
Apr 24 14:52:14 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:14 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee 1G
Apr 24 14:52:14 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:14 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.611s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:14 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Deleted volume successfully.
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8072f50d-5366-45e0-be52-958b815685d2 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-b7070e5e-819f-4f92-a7e0-42c3e73f1670-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "cinder-553bcea7-596a-4c23-a3d0-34ed00748a8b-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-553bcea7-596a-4c23-a3d0-34ed00748a8b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "cinder-quobyte-553bcea7-596a-4c23-a3d0-34ed00748a8b" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-quobyte-553bcea7-596a-4c23-a3d0-34ed00748a8b" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22ffb40-2a2f-4340-abaf-404f043372c4]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:14 devstack sudo[89911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b
Apr 24 14:52:14 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:14 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05" returned: 0 in 0.813s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:14 devstack sudo[89913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05
Apr 24 14:52:14 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:15 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee 1G" returned: 0 in 0.788s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:15 devstack sudo[89915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee
Apr 24 14:52:15 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:15 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b" returned: 0 in 0.632s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:15 devstack sudo[89920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b
Apr 24 14:52:15 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:15 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cd15988c-b908-42ed-8892-52681ad3ac05" returned: 0 in 0.647s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-cd15988c-b908-42ed-8892-52681ad3ac05" released by "delete_volume" :: held 1.514s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created reservations ['74fdfcd9-8c6f-4a67-ab74-bfdfda7e4f1c', '9b991ddd-05cc-4cb9-a5da-a7059f33409e', '4669e2b4-dd87-4fd1-ab5c-cf6c2de9ecb8', '0385343a-e87e-43c8-8a06-66a67983f128'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:15 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee" returned: 0 in 0.711s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:15 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee is being set with open permissions: ugo+rw
Apr 24 14:52:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:15 devstack sudo[89926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:15 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:15 devstack sudo[89927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee
Apr 24 14:52:15 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:16 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-553bcea7-596a-4c23-a3d0-34ed00748a8b" returned: 0 in 0.727s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-quobyte-553bcea7-596a-4c23-a3d0-34ed00748a8b" released by "delete_volume" :: held 1.411s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Created reservations ['03f10585-350b-4b71-8d06-194110254beb', '7c7deb7a-9c24-408c-a2d1-a06ea0aba484', '3043156e-8f10-4416-9c60-4c70f01a80b1', 'bffab6b3-5e26-473a-8a37-ba0c98d8ab18'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-a173e531-88d3-43e1-8c71-e6133be96900-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-a173e531-88d3-43e1-8c71-e6133be96900-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-quobyte-a173e531-88d3-43e1-8c71-e6133be96900" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:16 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.667s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:16 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Deleted volume successfully.
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-a173e531-88d3-43e1-8c71-e6133be96900" acquired by "delete_volume" :: waited 0.049s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:16 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-f52bd60e-2220-447e-b08b-56d178c6dee5 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-cd15988c-b908-42ed-8892-52681ad3ac05-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[e892d78d-b10e-4e85-933d-0c371fc83b31]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:16 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:16 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee" returned: 0 in 0.749s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:16 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.info
Apr 24 14:52:16 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:16 devstack sudo[89934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900
Apr 24 14:52:16 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "cinder-13e951df-8747-41c0-876e-20fcafef0841-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-13e951df-8747-41c0-876e-20fcafef0841-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "cinder-quobyte-13e951df-8747-41c0-876e-20fcafef0841" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-quobyte-13e951df-8747-41c0-876e-20fcafef0841" acquired by "delete_volume" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afd548b-4e01-45d2-93eb-363ee97cbc65]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:17 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.617s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:17 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Deleted volume successfully.
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ac12735d-ce06-422f-89d0-ead6081a27a1 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-553bcea7-596a-4c23-a3d0-34ed00748a8b-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:17 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841
Apr 24 14:52:17 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:17 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.info" returned: 0 in 0.678s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:17 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.info is being set with open permissions: ugo+rw
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:17 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.info
Apr 24 14:52:17 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:17 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900" returned: 0 in 0.815s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:17 devstack sudo[89948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900
Apr 24 14:52:17 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:17 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841" returned: 0 in 0.641s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:17 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.info" returned: 0 in 0.531s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:17 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841
Apr 24 14:52:17 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.336s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:17 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-861f3c77-50e5-4a1f-b4bc-0013a987a543 tempest-VolumeDependencyTests-1782512249 None] Create snapshot completed successfully
Apr 24 14:52:18 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a173e531-88d3-43e1-8c71-e6133be96900" returned: 0 in 0.747s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-a173e531-88d3-43e1-8c71-e6133be96900" released by "delete_volume" :: held 1.630s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created reservations ['b2caab1c-b931-4065-ae7b-457cd175e786', '4303c5a9-64bc-42d2-811e-995b8c310923', '489d8cba-8961-49a4-80dc-4ae76ae6bdaa', '2c271bd3-9fc0-49fc-bb2e-eda85445d77f'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:18 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:18 devstack sudo[89958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:18 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-13e951df-8747-41c0-876e-20fcafef0841" returned: 0 in 0.541s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-quobyte-13e951df-8747-41c0-876e-20fcafef0841" released by "delete_volume" :: held 1.230s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Created reservations ['8274cade-3ad3-41bb-b6a0-9dfad3cc44dc', '51d2ea43-31f8-4297-bc7f-d73185dd4f24', '03187bcf-0804-48a9-bcc0-168e2c099202', '3c826c8f-951a-4ebb-9605-c74616359bfa'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:18 devstack sudo[89960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:18 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-703cf045-181c-420e-9253-f49b4484ac34-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-703cf045-181c-420e-9253-f49b4484ac34-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-quobyte-703cf045-181c-420e-9253-f49b4484ac34" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-703cf045-181c-420e-9253-f49b4484ac34" acquired by "delete_volume" :: waited 0.028s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8973c807-5dc6-4287-ab57-a3eaf8c76cd7]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:18 devstack sudo[89962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34
Apr 24 14:52:18 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:18 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.698s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:18 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Deleted volume successfully.
Apr 24 14:52:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-68ab673e-7090-476f-adb9-6f2f0474f013 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-a173e531-88d3-43e1-8c71-e6133be96900-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:19 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.557s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:19 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Deleted volume successfully.
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1eeb9ee9-65de-4531-be19-47817be02272 tempest-CreateVolumesFromImageTest-1477660909 None] Lock "cinder-13e951df-8747-41c0-876e-20fcafef0841-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Flow 'volume_create_manager' (50cefcdf-8e0b-441b-9c24-3d00b9a2c0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c500729-efc9-4b66-880f-24398f20c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c500729-efc9-4b66-880f-24398f20c647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-811851976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c53a6a7-e61d-4494-998c-076ce2037d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c767f0ffa85844d3a2a02071ed94f86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=73074865-fd1f-4c1d-be2d-9c5c3dcae0ee,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:19Z,use_quota=True,user_id='633f2bc2ab994e0ebeddb8133852f4f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47e3ea4-6b78-4d45-9e2a-9189ae135f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47e3ea4-6b78-4d45-9e2a-9189ae135f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9530611-14bb-414f-87c3-68514dd5b29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9530611-14bb-414f-87c3-68514dd5b29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1c53a6a7-e61d-4494-998c-076ce2037d48', 'volume_name': 'volume-1c53a6a7-e61d-4494-998c-076ce2037d48', 'volume_size': 1, 'snapshot_id': '73074865-fd1f-4c1d-be2d-9c5c3dcae0ee'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48db5964-d7fc-42da-9fb4-7981ada20d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48db5964-d7fc-42da-9fb4-7981ada20d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ebf473-31a7-43c7-a918-6dd557d0ddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:19 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Volume 1c53a6a7-e61d-4494-998c-076ce2037d48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1c53a6a7-e61d-4494-998c-076ce2037d48', 'volume_size': 1, 'snapshot_id': '73074865-fd1f-4c1d-be2d-9c5c3dcae0ee'}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-quobyte-73074865-fd1f-4c1d-be2d-9c5c3dcae0ee-1c53a6a7-e61d-4494-998c-076ce2037d48" by "_create_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-73074865-fd1f-4c1d-be2d-9c5c3dcae0ee-1c53a6a7-e61d-4494-998c-076ce2037d48" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Creating volume 1c53a6a7-e61d-4494-998c-076ce2037d48 from snapshot 73074865-fd1f-4c1d-be2d-9c5c3dcae0ee {{(pid=81510) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-quobyte-1c53a6a7-e61d-4494-998c-076ce2037d48" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-1c53a6a7-e61d-4494-998c-076ce2037d48" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] snapshot: 73074865-fd1f-4c1d-be2d-9c5c3dcae0ee, volume: 1c53a6a7-e61d-4494-998c-076ce2037d48,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:52:19 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34" returned: 0 in 0.816s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f26dd4-d56e-480e-b8c4-736cb105af29]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:19 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:19 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34
Apr 24 14:52:19 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:19 devstack sudo[89970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee
Apr 24 14:52:19 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:20 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-703cf045-181c-420e-9253-f49b4484ac34" returned: 0 in 0.710s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-703cf045-181c-420e-9253-f49b4484ac34" released by "delete_volume" :: held 1.569s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created reservations ['40b81849-72b6-442a-819f-20f94c3cc3c7', '37871a9f-4385-4944-bf49-119a3985a3af', '0a642793-df1e-47cb-acde-1350b10dfff9', 'c901ad6e-b7f4-45bb-9fc8-13c9b6dd9e4f'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:20 devstack sudo[89977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:20 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:20 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee" returned: 0 in 0.907s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6dd263-6e3a-47f9-8319-32d9d3d6b6fb]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:20 devstack sudo[89979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151
Apr 24 14:52:20 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:20 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Flow 'volume_create_manager' (ccbbbb73-cbe3-4e22-825d-1c9e42a74177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d448735-a65b-4a0e-8949-781f49bfe418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d448735-a65b-4a0e-8949-781f49bfe418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1980639537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdd0092-73d9-490a-a0b7-cd2a078c988c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e968155600437983a106f8ee864ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:21Z,use_quota=True,user_id='58ce26b72a6d468c966135369b7fcb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803b3642-5b20-4e5b-b0e6-6ffff38af5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803b3642-5b20-4e5b-b0e6-6ffff38af5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9cbc7c-17de-4efb-be83-2ae64d947171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:21 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9cbc7c-17de-4efb-be83-2ae64d947171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfdd0092-73d9-490a-a0b7-cd2a078c988c', 'volume_name': 'volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f33d368-7afb-484e-ab03-91c1d134ff7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f33d368-7afb-484e-ab03-91c1d134ff7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a466088-ab63-4c19-b362-3e854251a075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:21 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Volume dfdd0092-73d9-490a-a0b7-cd2a078c988c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c', 'volume_size': 1}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-6932c480-0467-4239-b11b-bb9dd47c9f8c-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.703s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-6932c480-0467-4239-b11b-bb9dd47c9f8c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:21 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Deleted volume successfully.
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-bdb31e34-be55-4b9c-b8b1-c6e309a63e83 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-703cf045-181c-420e-9253-f49b4484ac34-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-quobyte-6932c480-0467-4239-b11b-bb9dd47c9f8c" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:21 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151" returned: 0 in 0.703s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48 not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-6932c480-0467-4239-b11b-bb9dd47c9f8c" acquired by "delete_volume" :: waited 0.036s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:21 devstack sudo[89985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48
Apr 24 14:52:21 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[968f4c48-86ba-4513-b913-776e01f46459]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:21 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c
Apr 24 14:52:21 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:21 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c" returned: 0 in 0.631s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:21 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:21 devstack sudo[89999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c
Apr 24 14:52:21 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (40a7f4fe-2307-4451-9c98-999b9e733116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f962e486-e1f4-4f3c-b2b6-d8f4ec217a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f962e486-e1f4-4f3c-b2b6-d8f4ec217a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249395703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa29385a-3fb1-4425-941b-a4fab3394251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:23Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd92c1d2-3711-471e-ac2d-bc35be447657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd92c1d2-3711-471e-ac2d-bc35be447657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ea38e7-550d-4ebb-9794-79a9a686373f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ea38e7-550d-4ebb-9794-79a9a686373f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa29385a-3fb1-4425-941b-a4fab3394251', 'volume_name': 'volume-aa29385a-3fb1-4425-941b-a4fab3394251', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7e3aaa-d893-46d5-9536-3050e1a929a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7e3aaa-d893-46d5-9536-3050e1a929a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0ab552-cbf5-4897-bae8-ce5ece99dab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:22 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume aa29385a-3fb1-4425-941b-a4fab3394251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa29385a-3fb1-4425-941b-a4fab3394251', 'volume_size': 1}
Apr 24 14:52:22 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:23 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-6932c480-0467-4239-b11b-bb9dd47c9f8c" returned: 0 in 1.143s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-6932c480-0467-4239-b11b-bb9dd47c9f8c" released by "delete_volume" :: held 1.842s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created reservations ['9786bdb7-48c1-4ff8-a08d-3cd5790649e2', 'd45bde44-6a5a-4289-abfd-cf346275aa47', '83075c7a-98f9-471a-b2c0-0e3b457ac3ae', 'dbc6fe9d-d58c-4384-8eed-8b9c5f7585b1'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:23 devstack sudo[90006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:23 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-a59793e1-1759-4782-a89a-6bdbc2ad6fee-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-a59793e1-1759-4782-a89a-6bdbc2ad6fee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-quobyte-a59793e1-1759-4782-a89a-6bdbc2ad6fee" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-a59793e1-1759-4782-a89a-6bdbc2ad6fee" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bb0539-f148-4f9a-8737-af31b710f7aa]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:23 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:23 devstack sudo[90008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee
Apr 24 14:52:23 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:24 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 1.201s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:24 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:24 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Deleted volume successfully.
Apr 24 14:52:24 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-d8152c5c-12de-4683-a132-b2a0de67b537 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-6932c480-0467-4239-b11b-bb9dd47c9f8c-delete_volume" released by "delete_volume" :: held 3.496s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:24 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee" returned: 0 in 1.191s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:24 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:24 devstack sudo[90046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee
Apr 24 14:52:24 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:25 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:25 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a59793e1-1759-4782-a89a-6bdbc2ad6fee" returned: 0 in 0.971s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:25 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-a59793e1-1759-4782-a89a-6bdbc2ad6fee" released by "delete_volume" :: held 2.253s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:25 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created reservations ['e72028f1-b43e-42d5-8936-2afb16bdf6ed', '01408de1-d8dc-44a7-95d3-b0199a043d26', '6ea52549-cc0f-48e0-ba6b-338e1dad4329', '5e84e7a9-ae99-4d96-9881-14a43dffb93b'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:26 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:26 devstack sudo[90051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:26 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:26 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:26 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-f0b5393d-f5e9-4625-801a-87bb189ba1c8-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48" returned: 0 in 5.753s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:26 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a09b9f-727c-4072-94ab-120d09d9d485]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:26 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:26 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-f0b5393d-f5e9-4625-801a-87bb189ba1c8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "cinder-quobyte-f0b5393d-f5e9-4625-801a-87bb189ba1c8" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-f0b5393d-f5e9-4625-801a-87bb189ba1c8" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:27 devstack sudo[90054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151
Apr 24 14:52:27 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[048f0ff1-ac6e-4235-8886-0a6d9a15d489]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:27 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.990s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:27 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Deleted volume successfully.
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-1be58e49-03ba-434f-9f90-4a03b03a45be tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-a59793e1-1759-4782-a89a-6bdbc2ad6fee-delete_volume" released by "delete_volume" :: held 3.692s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:27 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8
Apr 24 14:52:27 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8" returned: 0 in 0.541s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:27 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:27 devstack sudo[90064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8
Apr 24 14:52:27 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:27 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151" returned: 0 in 0.692s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48 {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:52:27 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Converted 1024.00 MB image at 177.87 MB/s
Apr 24 14:52:27 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48 is being set with open permissions: ugo+rw
Apr 24 14:52:27 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:27 devstack sudo[90066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48
Apr 24 14:52:27 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:28 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-f0b5393d-f5e9-4625-801a-87bb189ba1c8" returned: 0 in 0.466s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-quobyte-f0b5393d-f5e9-4625-801a-87bb189ba1c8" released by "delete_volume" :: held 1.046s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:28 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48" returned: 0 in 0.444s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-1c53a6a7-e61d-4494-998c-076ce2037d48" released by "_copy_volume_from_snapshot" :: held 8.667s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-73074865-fd1f-4c1d-be2d-9c5c3dcae0ee-1c53a6a7-e61d-4494-998c-076ce2037d48" released by "_create_volume_from_snapshot" :: held 8.709s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.724s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.032s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1980639537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdd0092-73d9-490a-a0b7-cd2a078c988c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e968155600437983a106f8ee864ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:21Z,use_quota=True,user_id='58ce26b72a6d468c966135369b7fcb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Creating volume dfdd0092-73d9-490a-a0b7-cd2a078c988c {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:28 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:28 devstack sudo[90070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c 1073741824
Apr 24 14:52:28 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ebf473-31a7-43c7-a918-6dd557d0ddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c53a6a7-e61d-4494-998c-076ce2037d48', 'volume_size': 1, 'snapshot_id': '73074865-fd1f-4c1d-be2d-9c5c3dcae0ee'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48370bdf-a8d1-4cc1-b8ea-50511c8532ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Created reservations ['33c14fb7-3f49-45fb-a657-d0d2a87632d7', 'e3db0298-3a28-4b21-b6af-913989a1c003', 'e899a4ff-7117-4c91-b245-eb5639390a20', 'd7253f6e-0f1e-4cb0-91bd-94e85ef5db7b'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:28 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Volume volume-1c53a6a7-e61d-4494-998c-076ce2037d48 (1c53a6a7-e61d-4494-998c-076ce2037d48): created successfully
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48370bdf-a8d1-4cc1-b8ea-50511c8532ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Flow 'volume_create_manager' (50cefcdf-8e0b-441b-9c24-3d00b9a2c0a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:28 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-9d48ac1d-a81b-4a00-804e-f556b94ec350 tempest-VolumeDependencyTests-1782512249 None] Created volume successfully.
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:28 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:28 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:28 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.487s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:28 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Deleted volume successfully.
Apr 24 14:52:28 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c 1073741824" returned: 0 in 0.651s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-def48e9f-8cc9-4240-be99-b5cb877ee389 tempest-CreateVolumesFromSourceVolumeTest-676912042 None] Lock "cinder-f0b5393d-f5e9-4625-801a-87bb189ba1c8-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:28 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:28 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c
Apr 24 14:52:28 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-73074865-fd1f-4c1d-be2d-9c5c3dcae0ee-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-73074865-fd1f-4c1d-be2d-9c5c3dcae0ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-quobyte-c1d0d57f-aa1c-457d-8388-1c400e5a8151" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-c1d0d57f-aa1c-457d-8388-1c400e5a8151" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-quobyte-73074865-fd1f-4c1d-be2d-9c5c3dcae0ee" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-73074865-fd1f-4c1d-be2d-9c5c3dcae0ee" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Deleting offline snapshot 73074865-fd1f-4c1d-be2d-9c5c3dcae0ee of volume c1d0d57f-aa1c-457d-8388-1c400e5a8151 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] snapshot_file for this snap is: volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2be083-983c-44d4-8a59-d31ea1d40510]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:29 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee
Apr 24 14:52:29 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:29 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c" returned: 0 in 0.540s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.503s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249395703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa29385a-3fb1-4425-941b-a4fab3394251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:23Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Creating volume aa29385a-3fb1-4425-941b-a4fab3394251 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:29 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a466088-ab63-4c19-b362-3e854251a075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62187177-202b-481e-a2eb-7e830d518ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:29 devstack sudo[90083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251 1073741824
Apr 24 14:52:29 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:29 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Volume volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c (dfdd0092-73d9-490a-a0b7-cd2a078c988c): created successfully
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62187177-202b-481e-a2eb-7e830d518ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Flow 'volume_create_manager' (ccbbbb73-cbe3-4e22-825d-1c9e42a74177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:29 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-85378423-a241-4827-b5da-086299dbe60b tempest-SnapshotDependencyTests-1828474532 None] Created volume successfully.
Apr 24 14:52:29 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee" returned: 0 in 0.567s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa824301-9353-44e4-ac53-ea51542d4997]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:29 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:29 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151
Apr 24 14:52:29 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:30 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251 1073741824" returned: 0 in 0.855s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:30 devstack sudo[90093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251
Apr 24 14:52:30 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:30 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151" returned: 0 in 0.784s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:30 devstack sudo[90098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee
Apr 24 14:52:30 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:30 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251" returned: 0 in 0.478s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.625s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] Creating offline snapshot d7f000aa-179f-4fa2-944b-55b291c012ee of volume dfdd0092-73d9-490a-a0b7-cd2a078c988c {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0ab552-cbf5-4897-bae8-ce5ece99dab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa29385a-3fb1-4425-941b-a4fab3394251', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509a1f2e-7f67-4369-940b-abb25bcab363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57d74da-cb69-43aa-99cf-f58b945be2c8]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:30 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume volume-aa29385a-3fb1-4425-941b-a4fab3394251 (aa29385a-3fb1-4425-941b-a4fab3394251): created successfully
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509a1f2e-7f67-4369-940b-abb25bcab363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:30 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (40a7f4fe-2307-4451-9c98-999b9e733116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:30 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-b4a22785-d87e-44f3-b083-79c1aa91d8ba tempest-CreateVolumesFromSnapshotTest-156165653 None] Created volume successfully.
Apr 24 14:52:30 devstack sudo[90101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c
Apr 24 14:52:30 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:31 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee" returned: 0 in 0.584s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:31 devstack sudo[90106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee
Apr 24 14:52:31 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:31 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c" returned: 0 in 0.713s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:31 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee 1G
Apr 24 14:52:31 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:31 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151.73074865-fd1f-4c1d-be2d-9c5c3dcae0ee" returned: 0 in 0.484s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-73074865-fd1f-4c1d-be2d-9c5c3dcae0ee" released by "_delete_snapshot" :: held 2.553s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-c1d0d57f-aa1c-457d-8388-1c400e5a8151" released by "delete_snapshot" :: held 2.592s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Created reservations ['349fa82a-35ff-49af-a341-c598b30a8164', '2dbc0d28-5d46-4b08-a48a-e2fcf7717271', '566010cf-c4f3-428c-aa9e-dd7cd4936c9b', '86c6450f-9ffe-4dcc-aaba-336aa4bcf60e'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:31 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Delete snapshot completed successfully.
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4213cefe-c48f-43b0-8edf-eaf43e76bbf9 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-73074865-fd1f-4c1d-be2d-9c5c3dcae0ee-delete_snapshot" released by "delete_snapshot" :: held 2.739s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Flow 'volume_create_manager' (d72bbcdc-b7d3-4cf1-a308-26178a08167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a463411e-e6b4-4bb5-8491-3fe82995c0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a463411e-e6b4-4bb5-8491-3fe82995c0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfea5bb4-8a0b-4056-a02d-5ce9e59250ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a45745e2fd43b9ac7a2c8f7855a01a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:32Z,use_quota=True,user_id='22f1331fe0af40d1b79e320301ddfe50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0dd6ed-6824-4910-8f6b-a607565a6599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0dd6ed-6824-4910-8f6b-a607565a6599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052f16d8-a269-4874-b11d-931f43f9f86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052f16d8-a269-4874-b11d-931f43f9f86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfea5bb4-8a0b-4056-a02d-5ce9e59250ac', 'volume_name': 'volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9e719d-920e-4380-a9e6-9c7a3d1d5466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9e719d-920e-4380-a9e6-9c7a3d1d5466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5d7ed2-370b-4bdd-b042-8dc576c80722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:31 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Volume bfea5bb4-8a0b-4056-a02d-5ce9e59250ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac', 'volume_size': 1}
Apr 24 14:52:31 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:32 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee 1G" returned: 0 in 0.628s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:32 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee
Apr 24 14:52:32 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-c1d0d57f-aa1c-457d-8388-1c400e5a8151-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-c1d0d57f-aa1c-457d-8388-1c400e5a8151-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-quobyte-c1d0d57f-aa1c-457d-8388-1c400e5a8151" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:32 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-c1d0d57f-aa1c-457d-8388-1c400e5a8151" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:32 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dc5fcc-b023-475b-94a1-66fff48b0147]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:32 devstack sudo[90121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151
Apr 24 14:52:32 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:32 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee" returned: 0 in 0.514s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:32 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee is being set with open permissions: ugo+rw
Apr 24 14:52:32 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:32 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee
Apr 24 14:52:32 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:33 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151" returned: 0 in 0.538s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:33 devstack sudo[90131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151
Apr 24 14:52:33 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:33 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee" returned: 0 in 0.482s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:33 devstack sudo[90133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.info
Apr 24 14:52:33 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:33 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-c1d0d57f-aa1c-457d-8388-1c400e5a8151" returned: 0 in 0.436s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-c1d0d57f-aa1c-457d-8388-1c400e5a8151" released by "delete_volume" :: held 1.033s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Created reservations ['1acf4c36-74ce-4cef-a624-140cec3cac6e', '4ead84f6-28f2-4a00-9c48-f29f63965b00', '8c19159f-1974-423c-8a6b-a82175c960fd', 'f3b0445e-6fba-42f5-9927-26c991ceb8e8'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:33 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.info" returned: 0 in 0.474s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:33 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.info is being set with open permissions: ugo+rw
Apr 24 14:52:33 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:33 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:33 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:33 devstack sudo[90138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.info
Apr 24 14:52:33 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:34 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.info" returned: 0 in 0.420s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.327s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:34 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.510s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] Creating offline snapshot bedd8b95-52f3-4128-96f3-084875ef838a of volume aa29385a-3fb1-4425-941b-a4fab3394251 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.480s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:34 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Deleted volume successfully.
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92fcbd3-c2a6-4d72-9142-7064409ce4d7]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:34 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e3c62b65-0b22-4fef-bd97-77797441d701 tempest-SnapshotDependencyTests-1828474532 None] Create snapshot completed successfully
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-ead463de-d026-4fc0-8f8c-3aa88c0286ed tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-c1d0d57f-aa1c-457d-8388-1c400e5a8151-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:34 devstack sudo[90143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251
Apr 24 14:52:34 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:34 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251" returned: 0 in 0.561s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:34 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a 1G
Apr 24 14:52:34 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Flow 'volume_create_manager' (8c73b48d-3d6b-46c4-8820-f5da522c83f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7767b8cb-9aad-451c-81fc-5de17f2e62f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7767b8cb-9aad-451c-81fc-5de17f2e62f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e40efc-95d5-466f-a7b0-795a5b5582ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e968155600437983a106f8ee864ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d7f000aa-179f-4fa2-944b-55b291c012ee,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:35Z,use_quota=True,user_id='58ce26b72a6d468c966135369b7fcb4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ead95bf-3b11-47cb-af6a-428700a883e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ead95bf-3b11-47cb-af6a-428700a883e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d74f52-85f2-494a-950a-9b0b5edb57c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d74f52-85f2-494a-950a-9b0b5edb57c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62e40efc-95d5-466f-a7b0-795a5b5582ea', 'volume_name': 'volume-62e40efc-95d5-466f-a7b0-795a5b5582ea', 'volume_size': 1, 'snapshot_id': 'd7f000aa-179f-4fa2-944b-55b291c012ee'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0bead0-d304-4943-b5af-a4f971f7993b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0bead0-d304-4943-b5af-a4f971f7993b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9776ed-a7ee-43d4-9cd3-7691fd2e7043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:34 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Volume 62e40efc-95d5-466f-a7b0-795a5b5582ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62e40efc-95d5-466f-a7b0-795a5b5582ea', 'volume_size': 1, 'snapshot_id': 'd7f000aa-179f-4fa2-944b-55b291c012ee'}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Flow 'volume_create_manager' (508b3974-c8f6-492d-8773-d4581fbfd1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:34 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c634235-11ca-459a-83da-6e68cf0b6d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c634235-11ca-459a-83da-6e68cf0b6d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1241545744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5dd40b-2a83-442a-a78e-9e2c841bd375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c767f0ffa85844d3a2a02071ed94f86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:35Z,use_quota=True,user_id='633f2bc2ab994e0ebeddb8133852f4f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f65c1eb-b8d5-4274-9496-b0577e716084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f65c1eb-b8d5-4274-9496-b0577e716084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a6ea55-3ac9-4452-a32c-74f666685ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a6ea55-3ac9-4452-a32c-74f666685ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e5dd40b-2a83-442a-a78e-9e2c841bd375', 'volume_name': 'volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9857ab83-44b1-42e6-a7ae-f81e993fc54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9857ab83-44b1-42e6-a7ae-f81e993fc54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2845040b-9088-4698-b5bd-860a54f1456e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:35 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Volume 0e5dd40b-2a83-442a-a78e-9e2c841bd375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375', 'volume_size': 1}
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:35 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a 1G" returned: 0 in 0.681s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa29385a-3fb1-4425-941b-a4fab3394251 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:35 devstack sudo[90153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa29385a-3fb1-4425-941b-a4fab3394251 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a
Apr 24 14:52:35 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:35 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa29385a-3fb1-4425-941b-a4fab3394251 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a" returned: 0 in 0.500s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:35 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a is being set with open permissions: ugo+rw
Apr 24 14:52:35 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:35 devstack sudo[90158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a
Apr 24 14:52:35 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:36 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a" returned: 0 in 0.440s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:36 devstack sudo[90161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.info
Apr 24 14:52:36 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:36 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.info" returned: 0 in 0.438s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:36 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.info is being set with open permissions: ugo+rw
Apr 24 14:52:36 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:36 devstack sudo[90164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.info
Apr 24 14:52:36 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:37 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.info" returned: 0 in 0.435s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.152s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.283s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfea5bb4-8a0b-4056-a02d-5ce9e59250ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a45745e2fd43b9ac7a2c8f7855a01a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:32Z,use_quota=True,user_id='22f1331fe0af40d1b79e320301ddfe50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Creating volume bfea5bb4-8a0b-4056-a02d-5ce9e59250ac {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:37 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:37 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac 1073741824
Apr 24 14:52:37 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:37 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-9d9aa54d-e952-4278-9b6e-ab8843756e35 tempest-CreateVolumesFromSnapshotTest-156165653 None] Create snapshot completed successfully
Apr 24 14:52:37 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac 1073741824" returned: 0 in 0.608s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:37 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:37 devstack sudo[90172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac
Apr 24 14:52:37 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (b1c2821f-c9ce-4c82-8c49-ea7b304b9c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab8bb2e-b2b7-4c71-ad63-2409b9915c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab8bb2e-b2b7-4c71-ad63-2409b9915c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2136602913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2e2fa3-75f8-4453-a9ba-fea638430a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:38Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a762838-0963-4372-8819-4c1e93b34791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a762838-0963-4372-8819-4c1e93b34791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5952a50d-73e7-47ed-a41c-c936ae2a4120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5952a50d-73e7-47ed-a41c-c936ae2a4120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2e2fa3-75f8-4453-a9ba-fea638430a5d', 'volume_name': 'volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0205594-994e-4cd5-954f-a84a3738cdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0205594-994e-4cd5-954f-a84a3738cdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d01365-b9f4-45a5-bd6b-6621924dc4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume 8b2e2fa3-75f8-4453-a9ba-fea638430a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d', 'volume_size': 1}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (8a7f9837-c5d3-42ff-b473-b7b5462e5257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ef650c-b86f-4303-a038-27e3175fe1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac" returned: 0 in 0.477s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.517s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "cinder-quobyte-d7f000aa-179f-4fa2-944b-55b291c012ee-62e40efc-95d5-466f-a7b0-795a5b5582ea" by "_create_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5d7ed2-370b-4bdd-b042-8dc576c80722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab29f3a1-26d2-4b6e-9d6d-ee91e5f69c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ef650c-b86f-4303-a038-27e3175fe1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2123820152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda13be5-a155-4dcc-9010-b553c38dbc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:38Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2ae6ca-af9a-4bf3-87d3-a5320436b7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2ae6ca-af9a-4bf3-87d3-a5320436b7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52fd92e-b157-4e87-8b80-7466ebb789b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52fd92e-b157-4e87-8b80-7466ebb789b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda13be5-a155-4dcc-9010-b553c38dbc1f', 'volume_name': 'volume-cda13be5-a155-4dcc-9010-b553c38dbc1f', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea066f0a-c99c-47f5-97f5-52ce83fe387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea066f0a-c99c-47f5-97f5-52ce83fe387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d98ffb6-5180-49b9-9d7b-7f94b8e1ce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume cda13be5-a155-4dcc-9010-b553c38dbc1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda13be5-a155-4dcc-9010-b553c38dbc1f', 'volume_size': 1}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:38 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Volume volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac (bfea5bb4-8a0b-4056-a02d-5ce9e59250ac): created successfully
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab29f3a1-26d2-4b6e-9d6d-ee91e5f69c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Flow 'volume_create_manager' (d72bbcdc-b7d3-4cf1-a308-26178a08167a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-d7f000aa-179f-4fa2-944b-55b291c012ee-62e40efc-95d5-466f-a7b0-795a5b5582ea" acquired by "_create_volume_from_snapshot" :: waited 0.074s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Creating volume 62e40efc-95d5-466f-a7b0-795a5b5582ea from snapshot d7f000aa-179f-4fa2-944b-55b291c012ee {{(pid=81510) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "cinder-quobyte-62e40efc-95d5-466f-a7b0-795a5b5582ea" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:38 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-55ca05de-828a-44c7-8ad2-c7f2d69f96b7 tempest-CinderUnicodeTest-291915786 None] Created volume successfully.
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-62e40efc-95d5-466f-a7b0-795a5b5582ea" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] snapshot: d7f000aa-179f-4fa2-944b-55b291c012ee, volume: 62e40efc-95d5-466f-a7b0-795a5b5582ea,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab42487-0b92-4b91-96cb-c611498686bc]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:38 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee
Apr 24 14:52:38 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (e50e218c-6566-4e9e-87f6-ab22f5a68d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b77fb0-1ac6-47ec-ba25-0c44c471fbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b77fb0-1ac6-47ec-ba25-0c44c471fbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1186772688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79107c2-2e0c-4cb3-83d4-a8a3db88f834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:39Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf1476f-8b84-47a1-819d-1ba3f6afaf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf1476f-8b84-47a1-819d-1ba3f6afaf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64687f53-a2c8-4ec2-8c10-a0bfd97277c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64687f53-a2c8-4ec2-8c10-a0bfd97277c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79107c2-2e0c-4cb3-83d4-a8a3db88f834', 'volume_name': 'volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa459901-c6e5-48b1-8bed-f2760e9d0d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa459901-c6e5-48b1-8bed-f2760e9d0d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa30b419-a21f-483e-a5ca-52cb6458fbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume a79107c2-2e0c-4cb3-83d4-a8a3db88f834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834', 'volume_size': 1}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (b7069632-1039-4eec-82a4-240dbf3c8698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad52adc-4331-4277-8920-9272665bb85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad52adc-4331-4277-8920-9272665bb85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934454500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b36c21-ca95-4152-82a9-99e13bb81db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:39Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b119246a-58a5-46b1-98b8-3624297a88b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b119246a-58a5-46b1-98b8-3624297a88b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144d2fa4-e2c2-4bf7-a560-f92a8dd9b62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144d2fa4-e2c2-4bf7-a560-f92a8dd9b62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b36c21-ca95-4152-82a9-99e13bb81db7', 'volume_name': 'volume-91b36c21-ca95-4152-82a9-99e13bb81db7', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30da38fb-125f-4294-a6bd-01dccf358dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30da38fb-125f-4294-a6bd-01dccf358dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f9fb4e-5419-4bcd-a145-3a0efefc5c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:38 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume 91b36c21-ca95-4152-82a9-99e13bb81db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b36c21-ca95-4152-82a9-99e13bb81db7', 'volume_size': 1}
Apr 24 14:52:38 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (c081a01c-a9cd-45f3-b667-9b56b14d0c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a79391e-12cb-4e03-931e-b427a2cce47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:39 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee" returned: 0 in 0.612s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a79391e-12cb-4e03-931e-b427a2cce47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-516622372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933997d7-b936-4e1d-91e7-53c20cad4d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:39Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2e1821-8fc1-418f-996d-5ba0095154e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2e1821-8fc1-418f-996d-5ba0095154e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45f8975-6fd4-499b-ae2a-9f247e8c9627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45f8975-6fd4-499b-ae2a-9f247e8c9627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '933997d7-b936-4e1d-91e7-53c20cad4d7e', 'volume_name': 'volume-933997d7-b936-4e1d-91e7-53c20cad4d7e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26b869f-173a-44eb-b9bb-42f3c383b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26b869f-173a-44eb-b9bb-42f3c383b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f218a56e-45f2-48fa-a402-0035e64f57f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:39 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume 933997d7-b936-4e1d-91e7-53c20cad4d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-933997d7-b936-4e1d-91e7-53c20cad4d7e', 'volume_size': 1}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b158b2a-258a-43d9-8b01-a2b332bce847]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:39 devstack sudo[90181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c
Apr 24 14:52:39 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Flow 'volume_create_manager' (5a7ca98f-f242-4ef8-a9d3-2f25d63496f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80c1904-9e1b-41ae-9302-fadf640940f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80c1904-9e1b-41ae-9302-fadf640940f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-192753062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c06292-6a1a-48a7-bbbb-022afb367088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a45745e2fd43b9ac7a2c8f7855a01a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:40Z,use_quota=True,user_id='22f1331fe0af40d1b79e320301ddfe50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1bafe5-937f-447b-9b42-e51537bac00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1bafe5-937f-447b-9b42-e51537bac00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd91615-3164-4606-b1be-d1f356ba74d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd91615-3164-4606-b1be-d1f356ba74d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c06292-6a1a-48a7-bbbb-022afb367088', 'volume_name': 'volume-47c06292-6a1a-48a7-bbbb-022afb367088', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d83c0f-fd11-44e8-a80a-3228c8ff8763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d83c0f-fd11-44e8-a80a-3228c8ff8763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733c4789-fa2e-4cce-be69-26b733f2c1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:39 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Volume 47c06292-6a1a-48a7-bbbb-022afb367088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c06292-6a1a-48a7-bbbb-022afb367088', 'volume_size': 1}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:39 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c" returned: 0 in 0.564s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:52:39 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:39 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea
Apr 24 14:52:39 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:43 devstack cinder-volume[81510]: DEBUG oslo_service.periodic_task [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 24 14:52:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:43 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:43 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:43 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:43 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:44 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.836s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:44 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-99b73c32-97d2-4ee5-b59c-9b912ae312ee None None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:44 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea" returned: 0 in 4.713s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:44 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[018afb4e-6745-4d8c-ac1f-6a65da6412dd]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:44 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:44 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c
Apr 24 14:52:44 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:45 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c" returned: 0 in 0.644s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:52:45 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Converted 1024.00 MB image at 217.18 MB/s
Apr 24 14:52:45 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea is being set with open permissions: ugo+rw
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:45 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea
Apr 24 14:52:45 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:45 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea" returned: 0 in 0.455s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-62e40efc-95d5-466f-a7b0-795a5b5582ea" released by "_copy_volume_from_snapshot" :: held 7.125s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-d7f000aa-179f-4fa2-944b-55b291c012ee-62e40efc-95d5-466f-a7b0-795a5b5582ea" released by "_create_volume_from_snapshot" :: held 7.168s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.243s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.598s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1241545744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5dd40b-2a83-442a-a78e-9e2c841bd375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c767f0ffa85844d3a2a02071ed94f86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:35Z,use_quota=True,user_id='633f2bc2ab994e0ebeddb8133852f4f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Creating volume 0e5dd40b-2a83-442a-a78e-9e2c841bd375 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:45 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:45 devstack sudo[90211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 1073741824
Apr 24 14:52:45 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9776ed-a7ee-43d4-9cd3-7691fd2e7043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e40efc-95d5-466f-a7b0-795a5b5582ea', 'volume_size': 1, 'snapshot_id': 'd7f000aa-179f-4fa2-944b-55b291c012ee'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68c3d50-308a-4cc3-a32b-b0a5f478d9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:45 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Volume volume-62e40efc-95d5-466f-a7b0-795a5b5582ea (62e40efc-95d5-466f-a7b0-795a5b5582ea): created successfully
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68c3d50-308a-4cc3-a32b-b0a5f478d9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:45 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Flow 'volume_create_manager' (8c73b48d-3d6b-46c4-8820-f5da522c83f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:45 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-8adb4a96-a9fb-4e44-8693-ede75e9650e6 tempest-SnapshotDependencyTests-1828474532 None] Created volume successfully.
Apr 24 14:52:46 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 1073741824" returned: 0 in 0.644s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:46 devstack sudo[90216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375
Apr 24 14:52:46 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "cinder-d7f000aa-179f-4fa2-944b-55b291c012ee-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-d7f000aa-179f-4fa2-944b-55b291c012ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "cinder-quobyte-dfdd0092-73d9-490a-a0b7-cd2a078c988c" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-dfdd0092-73d9-490a-a0b7-cd2a078c988c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "cinder-quobyte-d7f000aa-179f-4fa2-944b-55b291c012ee" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-d7f000aa-179f-4fa2-944b-55b291c012ee" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Deleting offline snapshot d7f000aa-179f-4fa2-944b-55b291c012ee of volume dfdd0092-73d9-490a-a0b7-cd2a078c988c {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] snapshot_file for this snap is: volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e8ab3-cb75-464f-af11-153e80456e1e]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:46 devstack sudo[90219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee
Apr 24 14:52:46 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:46 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375" returned: 0 in 0.461s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.550s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2136602913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2e2fa3-75f8-4453-a9ba-fea638430a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:38Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Creating volume 8b2e2fa3-75f8-4453-a9ba-fea638430a5d {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:46 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:46 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d 1073741824
Apr 24 14:52:46 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2845040b-9088-4698-b5bd-860a54f1456e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9185938d-6d34-4b2b-948a-0c0a91a82bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:46 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Volume volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 (0e5dd40b-2a83-442a-a78e-9e2c841bd375): created successfully
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9185938d-6d34-4b2b-948a-0c0a91a82bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:46 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Flow 'volume_create_manager' (508b3974-c8f6-492d-8773-d4581fbfd1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:46 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-36014e39-f356-4a72-aca4-9264ec55ea26 tempest-VolumeDependencyTests-1782512249 None] Created volume successfully.
Apr 24 14:52:47 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee" returned: 0 in 0.523s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af9797b-86c5-490e-80b2-1218f8fe254d]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:47 devstack sudo[90229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c
Apr 24 14:52:47 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:47 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d 1073741824" returned: 0 in 0.602s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:47 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d
Apr 24 14:52:47 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:47 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c" returned: 0 in 0.541s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:47 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee
Apr 24 14:52:47 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:47 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d" returned: 0 in 0.483s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.501s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2123820152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda13be5-a155-4dcc-9010-b553c38dbc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:38Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Creating volume cda13be5-a155-4dcc-9010-b553c38dbc1f {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:47 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d01365-b9f4-45a5-bd6b-6621924dc4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d1d7db-ef54-480c-8ee3-4c4692c0efd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:47 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f 1073741824
Apr 24 14:52:47 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:47 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d (8b2e2fa3-75f8-4453-a9ba-fea638430a5d): created successfully
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d1d7db-ef54-480c-8ee3-4c4692c0efd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:47 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (b1c2821f-c9ce-4c82-8c49-ea7b304b9c1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:48 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-aa0e1ab7-3f04-4347-8b56-f606ec6fccb1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Created volume successfully.
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.volume.flows.manager.create_volume [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81510) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Flow 'volume_create_manager' (518feec5-56b7-4eb0-bb1f-0bfd68dc9aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd770a1-5a20-4910-aeb9-6fd864415f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd770a1-5a20-4910-aeb9-6fd864415f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1494511930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5341a621-431e-431f-bf0c-0560d8c540b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c767f0ffa85844d3a2a02071ed94f86f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=0e5dd40b-2a83-442a-a78e-9e2c841bd375,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:48Z,use_quota=True,user_id='633f2bc2ab994e0ebeddb8133852f4f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035f2e26-d562-4a18-949b-730c589ac6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035f2e26-d562-4a18-949b-730c589ac6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b6c932-e4bd-4d29-bad7-66a78f927e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b6c932-e4bd-4d29-bad7-66a78f927e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5341a621-431e-431f-bf0c-0560d8c540b4', 'volume_name': 'volume-5341a621-431e-431f-bf0c-0560d8c540b4', 'volume_size': 1, 'source_volid': '0e5dd40b-2a83-442a-a78e-9e2c841bd375', 'source_volstatus': 'available'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7427f2-06a8-46fe-a6ba-2b3c587e9754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7427f2-06a8-46fe-a6ba-2b3c587e9754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6e4f60-fdf4-4015-a6f8-262866b3e3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:48 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Volume 5341a621-431e-431f-bf0c-0560d8c540b4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5341a621-431e-431f-bf0c-0560d8c540b4', 'volume_size': 1, 'source_volid': '0e5dd40b-2a83-442a-a78e-9e2c841bd375', 'source_volstatus': 'available'}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:48 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee" returned: 0 in 0.648s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:48 devstack sudo[90247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee
Apr 24 14:52:48 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:48 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f 1073741824" returned: 0 in 0.685s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:48 devstack sudo[90249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f
Apr 24 14:52:48 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:48 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c.d7f000aa-179f-4fa2-944b-55b291c012ee" returned: 0 in 0.495s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-d7f000aa-179f-4fa2-944b-55b291c012ee" released by "_delete_snapshot" :: held 2.325s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:48 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-dfdd0092-73d9-490a-a0b7-cd2a078c988c" released by "delete_snapshot" :: held 2.356s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Created reservations ['35c9c705-5ec5-42a7-a4d9-917076934c0d', '1854d410-5092-4e66-89fd-dafc0e02c5ab', 'f2e95186-d1ad-47ce-9c01-bc6c74c01683', '1d1f8a68-2958-4894-a758-4604b56e2486'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:49 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Delete snapshot completed successfully.
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-5b5b1f00-ed4f-41c9-95ab-7438d677a980 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-d7f000aa-179f-4fa2-944b-55b291c012ee-delete_snapshot" released by "delete_snapshot" :: held 2.508s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:49 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f" returned: 0 in 0.541s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.498s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1186772688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79107c2-2e0c-4cb3-83d4-a8a3db88f834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:39Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Creating volume a79107c2-2e0c-4cb3-83d4-a8a3db88f834 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:49 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d98ffb6-5180-49b9-9d7b-7f94b8e1ce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda13be5-a155-4dcc-9010-b553c38dbc1f', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:49 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834 1073741824
Apr 24 14:52:49 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fea894-bfe8-430f-823a-a91f85341284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:49 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume volume-cda13be5-a155-4dcc-9010-b553c38dbc1f (cda13be5-a155-4dcc-9010-b553c38dbc1f): created successfully
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fea894-bfe8-430f-823a-a91f85341284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (8a7f9837-c5d3-42ff-b473-b7b5462e5257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:49 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-f408f519-aad3-4dab-96fc-abbbdd8377b1 tempest-CreateVolumesFromSnapshotTest-156165653 None] Created volume successfully.
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "cinder-dfdd0092-73d9-490a-a0b7-cd2a078c988c-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-dfdd0092-73d9-490a-a0b7-cd2a078c988c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "cinder-quobyte-dfdd0092-73d9-490a-a0b7-cd2a078c988c" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-dfdd0092-73d9-490a-a0b7-cd2a078c988c" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc3ea76-218b-45de-aaeb-bc98b9e3d207]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:49 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834 1073741824" returned: 0 in 0.701s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:49 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:49 devstack sudo[90260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834
Apr 24 14:52:49 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:49 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c
Apr 24 14:52:49 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:50 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:50 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834" returned: 0 in 0.481s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.508s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-934454500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b36c21-ca95-4152-82a9-99e13bb81db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:39Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Creating volume 91b36c21-ca95-4152-82a9-99e13bb81db7 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:50 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa30b419-a21f-483e-a5ca-52cb6458fbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176b8c01-4026-498f-9f2c-91fa7b9fcb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:50 devstack sudo[90269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7 1073741824
Apr 24 14:52:50 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c" returned: 0 in 0.588s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:50 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834 (a79107c2-2e0c-4cb3-83d4-a8a3db88f834): created successfully
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176b8c01-4026-498f-9f2c-91fa7b9fcb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (e50e218c-6566-4e9e-87f6-ab22f5a68d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:50 devstack sudo[90271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c
Apr 24 14:52:50 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:50 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-35843c06-8766-4d42-b14c-8f758ab82a8f tempest-CreateVolumesFromSnapshotTest-156165653 None] Created volume successfully.
Apr 24 14:52:50 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:50 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-dfdd0092-73d9-490a-a0b7-cd2a078c988c" returned: 0 in 0.489s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-dfdd0092-73d9-490a-a0b7-cd2a078c988c" released by "delete_volume" :: held 1.146s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Created reservations ['fb5187f3-4c30-49cd-9721-0d0e3c74dc3b', '623532b5-f0b7-4366-a613-3cdf28b5e797', 'ae3e40de-98d3-4998-aab3-66a7c6d40c21', '81f8ffd6-3909-49e7-8cc4-3e25b99e0ef1'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:51 devstack sudo[90277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:51 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:51 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7 1073741824" returned: 0 in 0.676s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:51 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7
Apr 24 14:52:51 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:51 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.448s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:51 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Deleted volume successfully.
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a60f265f-d190-46d9-9a49-75e67fb0f936 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-dfdd0092-73d9-490a-a0b7-cd2a078c988c-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:51 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7" returned: 0 in 0.471s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.450s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-516622372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933997d7-b936-4e1d-91e7-53c20cad4d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83aadf2b0baf4aa39207c9f9669fcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:39Z,use_quota=True,user_id='cc0ba519fe3044b7a4d893e50dd05e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Creating volume 933997d7-b936-4e1d-91e7-53c20cad4d7e {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:51 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:51 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e 1073741824
Apr 24 14:52:51 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f9fb4e-5419-4bcd-a145-3a0efefc5c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b36c21-ca95-4152-82a9-99e13bb81db7', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3131083-3413-4489-be9f-cee69d4e44a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:51 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume volume-91b36c21-ca95-4152-82a9-99e13bb81db7 (91b36c21-ca95-4152-82a9-99e13bb81db7): created successfully
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3131083-3413-4489-be9f-cee69d4e44a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:51 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (b7069632-1039-4eec-82a4-240dbf3c8698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:51 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-46d8e85f-e862-4bbf-a1c6-4eaa25a3d5e0 tempest-CreateVolumesFromSnapshotTest-156165653 None] Created volume successfully.
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "cinder-62e40efc-95d5-466f-a7b0-795a5b5582ea-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-62e40efc-95d5-466f-a7b0-795a5b5582ea-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "cinder-quobyte-62e40efc-95d5-466f-a7b0-795a5b5582ea" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-62e40efc-95d5-466f-a7b0-795a5b5582ea" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[783d7691-cf60-4482-97db-085e527eb30a]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:52 devstack sudo[90294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea
Apr 24 14:52:52 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:52 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e 1073741824" returned: 0 in 0.675s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:52 devstack sudo[90297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e
Apr 24 14:52:52 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:52 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea" returned: 0 in 0.578s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:52 devstack sudo[90302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea
Apr 24 14:52:52 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:52 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e" returned: 0 in 0.424s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.049s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ed814b100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-24T12:52:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-192753062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c06292-6a1a-48a7-bbbb-022afb367088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a45745e2fd43b9ac7a2c8f7855a01a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:52:40Z,use_quota=True,user_id='22f1331fe0af40d1b79e320301ddfe50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30288913-373f-4273-b87b-999dcbfd9688),volume_type_id=30288913-373f-4273-b87b-999dcbfd9688)}" {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Creating volume 47c06292-6a1a-48a7-bbbb-022afb367088 {{(pid=81510) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Selected osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d as target Quobyte volume. {{(pid=81510) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 24 14:52:52 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] casted to osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088 1073741824 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f218a56e-45f2-48fa-a402-0035e64f57f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-933997d7-b936-4e1d-91e7-53c20cad4d7e', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:52 devstack sudo[90305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088 1073741824
Apr 24 14:52:52 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f9aae6-2c31-497d-a8cb-3a3dd4ed8665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:52 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Volume volume-933997d7-b936-4e1d-91e7-53c20cad4d7e (933997d7-b936-4e1d-91e7-53c20cad4d7e): created successfully
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f9aae6-2c31-497d-a8cb-3a3dd4ed8665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:52 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Flow 'volume_create_manager' (c081a01c-a9cd-45f3-b667-9b56b14d0c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:52 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-85978ace-08b7-4ea0-83ae-4c7c46f489de tempest-CreateVolumesFromSnapshotTest-156165653 None] Created volume successfully.
Apr 24 14:52:53 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-62e40efc-95d5-466f-a7b0-795a5b5582ea" returned: 0 in 0.468s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-quobyte-62e40efc-95d5-466f-a7b0-795a5b5582ea" released by "delete_volume" :: held 1.097s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:UPDATE=182,cinder:SELECT=133,cinder:INSERT=42,cinder:DELETE=26 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Created reservations ['0ed17db9-d315-418a-8c81-9bf0d714bce0', '811871ea-6226-4e14-90ad-3f97c2c95baa', 'c86c0150-63b5-463c-9f86-9ed085f0cd82', '9d139be1-e135-4219-943b-f00abd045b17'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-933997d7-b936-4e1d-91e7-53c20cad4d7e-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:53 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:53 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-933997d7-b936-4e1d-91e7-53c20cad4d7e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-quobyte-933997d7-b936-4e1d-91e7-53c20cad4d7e" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-933997d7-b936-4e1d-91e7-53c20cad4d7e" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[313780bf-a9eb-41ca-982d-b0fce2206d27]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:53 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088 1073741824" returned: 0 in 0.692s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:SELECT=151,cinder:UPDATE=203,cinder:DELETE=13,cinder:INSERT=46 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:53 devstack sudo[90313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e
Apr 24 14:52:53 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:53 devstack sudo[90314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088
Apr 24 14:52:53 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:53 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.522s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:53 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Deleted volume successfully.
Apr 24 14:52:53 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-9ab8e9bb-0250-459b-83c8-4a08a5777fe8 tempest-SnapshotDependencyTests-1828474532 None] Lock "cinder-62e40efc-95d5-466f-a7b0-795a5b5582ea-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:54 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088" returned: 0 in 0.474s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'} {{(pid=81510) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.729s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:54 devstack cinder-volume[81510]: INFO cinder.volume.drivers.remotefs [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Cloning volume 0e5dd40b-2a83-442a-a78e-9e2c841bd375 to volume 5341a621-431e-431f-bf0c-0560d8c540b4
Apr 24 14:52:54 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733c4789-fa2e-4cce-be69-26b733f2c1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c06292-6a1a-48a7-bbbb-022afb367088', 'volume_size': 1}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d9439f-fc06-4e0a-8319-cc0fe03a0631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e" returned: 0 in 0.577s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Creating offline snapshot f6c6f61d-f07c-42e9-8385-66a040fcd7f9 of volume 0e5dd40b-2a83-442a-a78e-9e2c841bd375 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:52:54 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e
Apr 24 14:52:54 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:54 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Volume volume-47c06292-6a1a-48a7-bbbb-022afb367088 (47c06292-6a1a-48a7-bbbb-022afb367088): created successfully
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d9439f-fc06-4e0a-8319-cc0fe03a0631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Flow 'volume_create_manager' (5a7ca98f-f242-4ef8-a9d3-2f25d63496f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede77540-c12e-4175-824b-38938f3f1258]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:54 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e6d23a64-8adc-4bb1-9f22-ca0ba65a6385 tempest-CinderUnicodeTest-291915786 None] Created volume successfully.
Apr 24 14:52:54 devstack sudo[90324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375
Apr 24 14:52:54 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:54 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-933997d7-b936-4e1d-91e7-53c20cad4d7e" returned: 0 in 0.524s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-933997d7-b936-4e1d-91e7-53c20cad4d7e" released by "delete_volume" :: held 1.141s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Created reservations ['e68096db-866e-43b8-a174-1a1ea7b174e0', '6157bcd1-2fa8-4d35-90d3-575371130520', 'd75de51f-4658-4ad1-bd5b-7fe170c77869', '8385d248-d604-4c24-bfd3-61cd4b8caf1d'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:54 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375" returned: 0 in 0.660s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:54 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:54 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:54 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:54 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9 1G
Apr 24 14:52:54 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:55 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.579s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:55 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Deleted volume successfully.
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-02411f6c-1c26-47d3-8e09-a8f15d72875e tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-933997d7-b936-4e1d-91e7-53c20cad4d7e-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:55 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9 1G" returned: 0 in 0.716s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:55 devstack sudo[90340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9
Apr 24 14:52:55 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-91b36c21-ca95-4152-82a9-99e13bb81db7-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-91b36c21-ca95-4152-82a9-99e13bb81db7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-quobyte-91b36c21-ca95-4152-82a9-99e13bb81db7" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-91b36c21-ca95-4152-82a9-99e13bb81db7" acquired by "delete_volume" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afda6cc-a267-441e-a961-fd07c2129c67]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:55 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:55 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7
Apr 24 14:52:55 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:56 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9" returned: 0 in 0.577s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:56 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9 is being set with open permissions: ugo+rw
Apr 24 14:52:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:56 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9
Apr 24 14:52:56 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:56 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7" returned: 0 in 0.595s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:56 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7
Apr 24 14:52:56 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:56 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9" returned: 0 in 0.463s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:56 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.info
Apr 24 14:52:56 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:56 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:56 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-91b36c21-ca95-4152-82a9-99e13bb81db7" returned: 0 in 0.519s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:56 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-91b36c21-ca95-4152-82a9-99e13bb81db7" released by "delete_volume" :: held 1.155s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:56 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Created reservations ['efb8b29d-29a4-4b42-979b-935822b65fd8', '8d1ee209-1fca-49ea-8226-f19bdceaa56b', 'e3c27add-c143-49e7-b607-6660add93133', '7d3015a0-27ca-40fc-b079-0f5f6653a6d3'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:57 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:57 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:57 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.info" returned: 0 in 0.550s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:57 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.info is being set with open permissions: ugo+rw
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:57 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.info
Apr 24 14:52:57 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:57 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.514s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:57 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Deleted volume successfully.
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-341ac161-ef8f-498e-8e34-e71b1a4346df tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-91b36c21-ca95-4152-82a9-99e13bb81db7-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:57 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.info" returned: 0 in 0.522s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-quobyte-5341a621-431e-431f-bf0c-0560d8c540b4" by "_copy_volume_from_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-5341a621-431e-431f-bf0c-0560d8c540b4" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] snapshot: f6c6f61d-f07c-42e9-8385-66a040fcd7f9, volume: 5341a621-431e-431f-bf0c-0560d8c540b4,  {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[9410a2eb-a20f-43f9-80bf-db3203d82a87]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:57 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9
Apr 24 14:52:57 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-a79107c2-2e0c-4cb3-83d4-a8a3db88f834-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-a79107c2-2e0c-4cb3-83d4-a8a3db88f834-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-quobyte-a79107c2-2e0c-4cb3-83d4-a8a3db88f834" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-a79107c2-2e0c-4cb3-83d4-a8a3db88f834" acquired by "delete_volume" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4a0d01-877e-4996-a218-2fad62ee80bb]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:57 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:58 devstack sudo[90370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834
Apr 24 14:52:58 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:58 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9" returned: 0 in 0.571s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:52:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 24 14:52:58 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Creating direct copy from snapshot {{(pid=81510) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 24 14:52:58 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[8759c58c-51c4-4254-bae4-266dbb5d559c]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:52:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:58 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375
Apr 24 14:52:58 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:58 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834" returned: 0 in 0.628s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:58 devstack sudo[90380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834
Apr 24 14:52:58 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:58 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375" returned: 0 in 0.629s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:58 devstack cinder-volume[81510]: DEBUG cinder.utils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Path /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4 not found in is_blk_device check {{(pid=81510) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 24 14:52:58 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:58 devstack sudo[90385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4
Apr 24 14:52:58 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:59 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-a79107c2-2e0c-4cb3-83d4-a8a3db88f834" returned: 0 in 0.463s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-a79107c2-2e0c-4cb3-83d4-a8a3db88f834" released by "delete_volume" :: held 1.132s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Created reservations ['a302bbf5-06fa-4768-b6d4-202ca00a566b', '3d7afba1-b63c-48e9-91ce-bba73f53c994', '426465c8-c04e-4d23-b2c1-e1a7852dd699', 'bf65d4cf-5616-42d5-a42c-03d7ee43deed'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:52:59 devstack sudo[90389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:52:59 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:52:59 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.604s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:52:59 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Deleted volume successfully.
Apr 24 14:52:59 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-3d07a360-18fa-4b55-bbdf-ba6787c58809 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-a79107c2-2e0c-4cb3-83d4-a8a3db88f834-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-cda13be5-a155-4dcc-9010-b553c38dbc1f-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-cda13be5-a155-4dcc-9010-b553c38dbc1f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-quobyte-cda13be5-a155-4dcc-9010-b553c38dbc1f" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:00 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-cda13be5-a155-4dcc-9010-b553c38dbc1f" acquired by "delete_volume" :: waited 0.032s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:00 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67caa8e-b51d-4087-9740-14be237f72a2]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:00 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:00 devstack sudo[90402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f
Apr 24 14:53:00 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:01 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f" returned: 0 in 1.230s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:01 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:01 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f
Apr 24 14:53:01 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:03 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-cda13be5-a155-4dcc-9010-b553c38dbc1f" returned: 0 in 1.811s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:03 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-cda13be5-a155-4dcc-9010-b553c38dbc1f" released by "delete_volume" :: held 3.166s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:03 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Created reservations ['af558e83-b306-4428-b57c-1148ddab0a1c', '8dd9e9b1-0c16-414b-9540-bd562b2f324c', '9517194c-c24b-4426-abdf-9a4b0a2c83dd', 'b2e7c923-88f7-4690-9ac8-984d1fbbeffb'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:53:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:53:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:53:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:53:03 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:53:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:53:03 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:03 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:53:03 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:04 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.918s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:53:04 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Deleted volume successfully.
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2c50be1a-7f77-42bb-9360-98cd766e4e41 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-cda13be5-a155-4dcc-9010-b553c38dbc1f-delete_volume" released by "delete_volume" :: held 4.522s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:04 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-8b2e2fa3-75f8-4453-a9ba-fea638430a5d-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4" returned: 0 in 5.895s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-8b2e2fa3-75f8-4453-a9ba-fea638430a5d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e1e6d1-ca4a-4db9-83d9-64d3f813c5c0]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-quobyte-8b2e2fa3-75f8-4453-a9ba-fea638430a5d" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-8b2e2fa3-75f8-4453-a9ba-fea638430a5d" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffcc4bc-6e5d-4633-bd99-4e8905f3574b]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:04 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:04 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375
Apr 24 14:53:04 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:05 devstack sudo[90416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d
Apr 24 14:53:05 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:05 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d" returned: 0 in 0.594s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:05 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d
Apr 24 14:53:05 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:05 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375" returned: 0 in 0.855s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:05 devstack cinder-volume[81510]: DEBUG cinder.image.image_utils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4 {{(pid=81510) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 24 14:53:05 devstack cinder-volume[81510]: INFO cinder.image.image_utils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Converted 1024.00 MB image at 173.62 MB/s
Apr 24 14:53:05 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4 is being set with open permissions: ugo+rw
Apr 24 14:53:05 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:05 devstack sudo[90427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4
Apr 24 14:53:05 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:06 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-8b2e2fa3-75f8-4453-a9ba-fea638430a5d" returned: 0 in 0.455s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-8b2e2fa3-75f8-4453-a9ba-fea638430a5d" released by "delete_volume" :: held 1.091s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Created reservations ['c2cbbc87-8956-4b69-b1a0-831dc5b99595', 'a5f57601-626d-41ad-bc5c-246279b31cd0', '57de232b-5915-49ce-a1e8-6999d7adede4', '270dff69-1900-42e6-9c8b-8dfbb0845d41'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:06 devstack sudo[90431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:53:06 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:06 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4" returned: 0 in 0.462s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-5341a621-431e-431f-bf0c-0560d8c540b4" released by "_copy_volume_from_snapshot" :: held 8.520s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-quobyte-f6c6f61d-f07c-42e9-8385-66a040fcd7f9" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-f6c6f61d-f07c-42e9-8385-66a040fcd7f9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Deleting offline snapshot f6c6f61d-f07c-42e9-8385-66a040fcd7f9 of volume 0e5dd40b-2a83-442a-a78e-9e2c841bd375 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] snapshot_file for this snap is: volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c327f77-5822-4e7e-8c6a-e9f633e4d93f]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:06 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9
Apr 24 14:53:06 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:06 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.454s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:53:06 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Deleted volume successfully.
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-a645f290-75f9-448d-89c4-9fc0a6c17f3f tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-8b2e2fa3-75f8-4453-a9ba-fea638430a5d-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:06 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9" returned: 0 in 0.528s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[314a2665-364b-4cc9-ba00-c839b6349904]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:06 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:06 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375
Apr 24 14:53:06 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-bedd8b95-52f3-4128-96f3-084875ef838a-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-bedd8b95-52f3-4128-96f3-084875ef838a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-quobyte-aa29385a-3fb1-4425-941b-a4fab3394251" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-aa29385a-3fb1-4425-941b-a4fab3394251" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-quobyte-bedd8b95-52f3-4128-96f3-084875ef838a" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-bedd8b95-52f3-4128-96f3-084875ef838a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Deleting offline snapshot bedd8b95-52f3-4128-96f3-084875ef838a of volume aa29385a-3fb1-4425-941b-a4fab3394251 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] snapshot_file for this snap is: volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec6744-8138-4630-a466-2adf7f8d5801]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:07 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a
Apr 24 14:53:07 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:07 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375" returned: 0 in 0.512s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:07 devstack sudo[90446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9
Apr 24 14:53:07 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:07 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a" returned: 0 in 0.545s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa29385a-3fb1-4425-941b-a4fab3394251(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab83024-cb68-40e7-8175-7dc480f39884]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:07 devstack sudo[90454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251
Apr 24 14:53:07 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:07 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9" returned: 0 in 0.517s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:07 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:07 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9
Apr 24 14:53:07 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:08 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251" returned: 0 in 0.526s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:08 devstack sudo[90462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a
Apr 24 14:53:08 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:08 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375.f6c6f61d-f07c-42e9-8385-66a040fcd7f9" returned: 0 in 0.453s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-f6c6f61d-f07c-42e9-8385-66a040fcd7f9" released by "_delete_snapshot" :: held 2.106s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.342s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.315s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6e4f60-fdf4-4015-a6f8-262866b3e3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5341a621-431e-431f-bf0c-0560d8c540b4', 'volume_size': 1, 'source_volid': '0e5dd40b-2a83-442a-a78e-9e2c841bd375', 'source_volstatus': 'available'}' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a917c1-bdd7-451d-8a90-2de808ffcdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 24 14:53:08 devstack cinder-volume[81510]: INFO cinder.volume.flows.manager.create_volume [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Volume volume-5341a621-431e-431f-bf0c-0560d8c540b4 (5341a621-431e-431f-bf0c-0560d8c540b4): created successfully
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a917c1-bdd7-451d-8a90-2de808ffcdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81510) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Flow 'volume_create_manager' (518feec5-56b7-4eb0-bb1f-0bfd68dc9aa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81510) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] Creating offline snapshot a0988e40-68f0-43ae-b2e9-b6fc56bb113e of volume 47c06292-6a1a-48a7-bbbb-022afb367088 {{(pid=81510) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93049c5-1a58-4a00-8d04-ba8f57a791ff]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:08 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-673baa28-0dda-467c-804a-65b6785b69a0 tempest-VolumeDependencyTests-1782512249 None] Created volume successfully.
Apr 24 14:53:08 devstack sudo[90464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088
Apr 24 14:53:08 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-0e5dd40b-2a83-442a-a78e-9e2c841bd375-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-0e5dd40b-2a83-442a-a78e-9e2c841bd375-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-quobyte-0e5dd40b-2a83-442a-a78e-9e2c841bd375" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-0e5dd40b-2a83-442a-a78e-9e2c841bd375" acquired by "delete_volume" :: waited 0.019s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:08 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a" returned: 0 in 0.643s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca111552-2fb2-4610-8ba0-a1a04570b9ba]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:08 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a
Apr 24 14:53:08 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:08 devstack sudo[90473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375
Apr 24 14:53:08 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:08 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088" returned: 0 in 0.566s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:08 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e 1G {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:09 devstack sudo[90477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e 1G
Apr 24 14:53:09 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:09 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251.bedd8b95-52f3-4128-96f3-084875ef838a" returned: 0 in 0.476s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-bedd8b95-52f3-4128-96f3-084875ef838a" released by "_delete_snapshot" :: held 2.302s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-aa29385a-3fb1-4425-941b-a4fab3394251" released by "delete_snapshot" :: held 2.335s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:09 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375" returned: 0 in 0.571s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Created reservations ['4b56f56f-4889-4682-9bbe-0a5e12533097', 'a5fa359f-8da8-48c9-9f8b-e008819ae71d', '95d5e870-e903-4042-b83f-583117bde73b', 'f73b265b-10bf-42c3-98cf-0cf481b1aeeb'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:53:09 devstack sudo[90486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375
Apr 24 14:53:09 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:09 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Delete snapshot completed successfully.
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-217f3c49-749c-4242-944c-0244104f6046 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-bedd8b95-52f3-4128-96f3-084875ef838a-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:09 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e 1G" returned: 0 in 0.616s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47c06292-6a1a-48a7-bbbb-022afb367088 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:09 devstack sudo[90488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47c06292-6a1a-48a7-bbbb-022afb367088 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e
Apr 24 14:53:09 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:09 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-0e5dd40b-2a83-442a-a78e-9e2c841bd375" returned: 0 in 0.476s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-0e5dd40b-2a83-442a-a78e-9e2c841bd375" released by "delete_volume" :: held 1.106s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:09 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Created reservations ['8f7a928d-827d-40a8-babe-2b172309f3bd', 'e5b3f50f-d8ba-4a65-b988-4ffa519bc002', '1b61d7b6-ded5-4470-8c9e-2c36ced41dad', '866a9866-ea88-4119-a6f9-bc3a5919db1b'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:10 devstack sudo[90494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:53:10 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:10 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47c06292-6a1a-48a7-bbbb-022afb367088 -F qcow2 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e" returned: 0 in 0.543s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:10 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e is being set with open permissions: ugo+rw
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:10 devstack sudo[90496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e
Apr 24 14:53:10 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-aa29385a-3fb1-4425-941b-a4fab3394251-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-aa29385a-3fb1-4425-941b-a4fab3394251-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "cinder-quobyte-aa29385a-3fb1-4425-941b-a4fab3394251" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-aa29385a-3fb1-4425-941b-a4fab3394251" acquired by "delete_volume" :: waited 0.020s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[62924d7f-17d6-472d-a8ab-5b3f1767a96a]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:10 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251
Apr 24 14:53:10 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:10 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.454s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:53:10 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Deleted volume successfully.
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2d03eb7c-b347-47be-9ac0-ba14cf067b68 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-0e5dd40b-2a83-442a-a78e-9e2c841bd375-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:10 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e" returned: 0 in 0.529s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:10 devstack sudo[90502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.info
Apr 24 14:53:10 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:10 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251" returned: 0 in 0.535s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:10 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251
Apr 24 14:53:10 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:10 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-5341a621-431e-431f-bf0c-0560d8c540b4-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-5341a621-431e-431f-bf0c-0560d8c540b4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-quobyte-5341a621-431e-431f-bf0c-0560d8c540b4" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-5341a621-431e-431f-bf0c-0560d8c540b4" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc55c1d8-4fe5-43e8-9d7f-687f7ad84da0]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:11 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4
Apr 24 14:53:11 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:11 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.info" returned: 0 in 0.490s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:11 devstack cinder-volume[81510]: WARNING cinder.volume.drivers.remotefs [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.info is being set with open permissions: ugo+rw
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.info {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:11 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.info
Apr 24 14:53:11 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:11 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-aa29385a-3fb1-4425-941b-a4fab3394251" returned: 0 in 0.460s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-quobyte-aa29385a-3fb1-4425-941b-a4fab3394251" released by "delete_volume" :: held 1.051s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Created reservations ['06475011-b104-454c-b208-a3a56872eaa1', '01b26df6-4476-4c91-b19e-ba6cb3affab1', '5f80a1a6-75a0-4782-9fee-37f431fb6feb', 'c49573ad-e490-4243-9434-84030728aeab'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:11 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:53:11 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:11 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.info" returned: 0 in 0.430s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.282s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:53:11 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4" returned: 0 in 0.570s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:11 devstack sudo[90521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4
Apr 24 14:53:11 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-146676b8-c734-4053-8a91-bd3cd203ee3f tempest-CinderUnicodeTest-291915786 None] Create snapshot completed successfully
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Acquiring lock "cinder-a0988e40-68f0-43ae-b2e9-b6fc56bb113e-delete_snapshot" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Lock "cinder-a0988e40-68f0-43ae-b2e9-b6fc56bb113e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Acquiring lock "cinder-quobyte-47c06292-6a1a-48a7-bbbb-022afb367088" by "delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Lock "cinder-quobyte-47c06292-6a1a-48a7-bbbb-022afb367088" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Acquiring lock "cinder-quobyte-a0988e40-68f0-43ae-b2e9-b6fc56bb113e" by "_delete_snapshot" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Lock "cinder-quobyte-a0988e40-68f0-43ae-b2e9-b6fc56bb113e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Deleting offline snapshot a0988e40-68f0-43ae-b2e9-b6fc56bb113e of volume 47c06292-6a1a-48a7-bbbb-022afb367088 {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] snapshot_file for this snap is: volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e {{(pid=81510) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[519dddf8-6a47-4f2c-be97-76273275bfdc]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:11 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:11 devstack sudo[90524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e
Apr 24 14:53:11 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.502s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:11 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:53:11 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Deleted volume successfully.
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-e84d591e-a68a-495d-8c22-561aad559009 tempest-CreateVolumesFromSnapshotTest-156165653 None] Lock "cinder-aa29385a-3fb1-4425-941b-a4fab3394251-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:12 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-5341a621-431e-431f-bf0c-0560d8c540b4" returned: 0 in 0.459s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-5341a621-431e-431f-bf0c-0560d8c540b4" released by "delete_volume" :: held 1.065s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Created reservations ['592ed6bb-f8b6-4c1e-80ca-9d665842fbc4', 'f047de3b-97eb-46fa-91d1-0e31c64628b6', '399f702b-e61c-485e-bb1d-9c56d610486c', '5400e319-2c01-4f59-9293-e35e4e431778'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:12 devstack sudo[90527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:53:12 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:12 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e" returned: 0 in 0.613s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.remotefs [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47c06292-6a1a-48a7-bbbb-022afb367088(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81510) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb8d176-9c87-4dd6-ad1d-6825abe6aa82]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:12 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088
Apr 24 14:53:12 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:12 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.512s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:53:12 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Deleted volume successfully.
Apr 24 14:53:12 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-de46f56f-ab1f-4db1-b69a-a2871c3fe464 tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-5341a621-431e-431f-bf0c-0560d8c540b4-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:13 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088" returned: 0 in 0.638s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:13 devstack sudo[90539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e
Apr 24 14:53:13 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-1c53a6a7-e61d-4494-998c-076ce2037d48-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-1c53a6a7-e61d-4494-998c-076ce2037d48-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "cinder-quobyte-1c53a6a7-e61d-4494-998c-076ce2037d48" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-1c53a6a7-e61d-4494-998c-076ce2037d48" acquired by "delete_volume" :: waited 0.027s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ff41db-48cd-4ac0-a764-44fc96ae1d80]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:13 devstack sudo[90541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48
Apr 24 14:53:13 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:13 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e" returned: 0 in 0.658s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:13 devstack sudo[90546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e
Apr 24 14:53:13 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:13 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48" returned: 0 in 0.609s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:13 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:14 devstack sudo[90551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48
Apr 24 14:53:14 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:14 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088.a0988e40-68f0-43ae-b2e9-b6fc56bb113e" returned: 0 in 0.473s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Lock "cinder-quobyte-a0988e40-68f0-43ae-b2e9-b6fc56bb113e" released by "_delete_snapshot" :: held 2.497s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Lock "cinder-quobyte-47c06292-6a1a-48a7-bbbb-022afb367088" released by "delete_snapshot" :: held 2.526s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Created reservations ['b6da6880-0237-4520-a766-c1b232d988ec', 'a6286866-e86b-4bc9-805d-82413e57e5b0', '3b01282d-c126-4ca3-b26f-4bde733017ad', 'f262b33c-7fce-4192-835d-dd3896027752'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:53:14 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-1c53a6a7-e61d-4494-998c-076ce2037d48" returned: 0 in 0.458s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-quobyte-1c53a6a7-e61d-4494-998c-076ce2037d48" released by "delete_volume" :: held 1.117s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:14 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Delete snapshot completed successfully.
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-fc0d0cc2-e757-40f1-a98b-0abf4a8fcdb7 tempest-CinderUnicodeTest-291915786 None] Lock "cinder-a0988e40-68f0-43ae-b2e9-b6fc56bb113e-delete_snapshot" released by "delete_snapshot" :: held 2.690s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Created reservations ['e8b24439-ec1e-44b4-9b85-502e1dc61a2e', '8030b6d6-b6f0-4649-9090-6547b7f3dd20', '7398a705-056c-47b8-a115-d14d7f7107d9', 'c410f13b-f74d-42b4-83d7-a32c42579a7f'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:53:14 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:14 devstack sudo[90555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:53:14 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Acquiring lock "cinder-47c06292-6a1a-48a7-bbbb-022afb367088-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Lock "cinder-47c06292-6a1a-48a7-bbbb-022afb367088-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:15 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Acquiring lock "cinder-quobyte-47c06292-6a1a-48a7-bbbb-022afb367088" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.482s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:15 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:53:15 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Deleted volume successfully.
Apr 24 14:53:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Lock "cinder-quobyte-47c06292-6a1a-48a7-bbbb-022afb367088" acquired by "delete_volume" :: waited 0.026s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:15 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c53fad2-22ca-4e63-8ad1-9ab62177cb7f tempest-VolumeDependencyTests-1782512249 None] Lock "cinder-1c53a6a7-e61d-4494-998c-076ce2037d48-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:15 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dc278d-e28b-49a1-8b16-812bd2866cc1]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:15 devstack sudo[90558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088
Apr 24 14:53:15 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:15 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088" returned: 0 in 0.513s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:15 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088 {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:15 devstack sudo[90563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088
Apr 24 14:53:15 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:16 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-47c06292-6a1a-48a7-bbbb-022afb367088" returned: 0 in 0.520s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Lock "cinder-quobyte-47c06292-6a1a-48a7-bbbb-022afb367088" released by "delete_volume" :: held 1.097s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Created reservations ['1442e9e6-8b91-4cde-8335-e4fd1b273ba0', '1762f33e-769b-4534-a688-96eb2685b49b', 'c4a01aa7-acec-46d5-9e58-709970cc768a', '167b8737-3dc5-47b1-9bb3-84a311891ec9'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:16 devstack sudo[90566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:53:16 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:16 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.465s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:53:16 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Deleted volume successfully.
Apr 24 14:53:16 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-2a9f1e20-3799-4c25-8355-98d9e437020f tempest-CinderUnicodeTest-291915786 None] Lock "cinder-47c06292-6a1a-48a7-bbbb-022afb367088-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Acquiring lock "cinder-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac-delete_volume" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Lock "cinder-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Acquiring lock "cinder-quobyte-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac" by "delete_volume" {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 24 14:53:17 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Lock "cinder-quobyte-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac" acquired by "delete_volume" :: waited 0.016s {{(pid=81510) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 24 14:53:17 devstack cinder-volume[81510]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81dc017-43d4-4d2f-979c-06d130f2a24d]: (4, 'qcow2') {{(pid=82581) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 24 14:53:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:17 devstack sudo[90569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac
Apr 24 14:53:17 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:17 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac" returned: 0 in 0.509s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:17 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:17 devstack sudo[90574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac
Apr 24 14:53:17 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:18 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca/volume-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac" returned: 0 in 0.433s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Lock "cinder-quobyte-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac" released by "delete_volume" :: held 0.981s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG cinder.quota [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Created reservations ['2c1f2f2f-0b9a-4ee8-939e-fc374a960066', '68b82a7c-42d1-41cf-9a89-b248a2e440a6', 'b567ab1e-8f4f-4331-8ae7-31d621faa381', '884a2f69-7e97-41fe-8412-aa5551236441'] {{(pid=81510) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d': None} {{(pid=81510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG cinder.volume.drivers.quobyte [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-124f7738-0d07-46ee-8650-68904fc9b40d'] {{(pid=81510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.lockutils [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81510) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 24 14:53:18 devstack sudo[90577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca
Apr 24 14:53:18 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 24 14:53:18 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG oslo_concurrency.processutils [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d64d3aadd2c3d477d8abba729bfc4ca" returned: 0 in 0.423s {{(pid=81510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG cinder.manager [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Notifying Schedulers of capabilities ... {{(pid=81510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 24 14:53:18 devstack cinder-volume[81510]: INFO cinder.volume.manager [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Deleted volume successfully.
Apr 24 14:53:18 devstack cinder-volume[81510]: DEBUG cinder.coordination [None req-4c79db27-5db1-4206-b024-991ec47ec167 tempest-CinderUnicodeTest-291915786 None] Lock "cinder-bfea5bb4-8a0b-4056-a02d-5ce9e59250ac-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=81510) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 24 14:53:28 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:DELETE=7,cinder:UPDATE=101,cinder:SELECT=66,cinder:INSERT=33 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 24 14:53:28 devstack cinder-volume[81510]: DEBUG dbcounter [-] [81510] Writing DB stats cinder:UPDATE=119,cinder:SELECT=80,cinder:INSERT=24,cinder:DELETE=8 {{(pid=81510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}